Sep 10 11:14:53 devstack cinder-volume[74812]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=74812) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 10 11:14:53 devstack cinder-volume[74812]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=74812) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 10 11:14:53 devstack cinder-volume[74812]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=74812) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 10 11:14:55 devstack cinder-volume[74812]: INFO dbcounter [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Registered counter for database cinder
Sep 10 11:14:55 devstack cinder-volume[74812]: DEBUG oslo_db.sqlalchemy.engines [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74812) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 11:14:55 devstack cinder-volume[74812]: DEBUG dbcounter [-] [74812] Writer thread running {{(pid=74812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 10 11:14:55 devstack cinder-volume[74812]: INFO cinder.rpc [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 10 11:14:55 devstack cinder-volume[74812]: INFO cinder.rpc [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 10 11:14:55 devstack cinder-volume[74812]: DEBUG oslo_db.sqlalchemy.engines [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74812) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 11:14:55 devstack cinder-volume[74812]: INFO cinder.volume.manager [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Determined volume DB was empty at startup.
Sep 10 11:14:55 devstack cinder-volume[74812]: DEBUG cinder.volume.manager [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=74812) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 10 11:14:55 devstack cinder-volume[74812]: INFO cinder.volume.manager [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 10 11:14:55 devstack cinder-volume[74812]: WARNING stevedore.named [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 10 11:14:55 devstack cinder-volume[74812]: WARNING castellan.key_manager [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 10 11:14:55 devstack cinder-volume[74812]: WARNING cinder.keymgr.conf_key_mgr [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 10 11:14:55 devstack cinder-volume[74812]: DEBUG cinder.volume.drivers.lvm [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=74812) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Sep 10 11:14:55 devstack cinder-volume[74812]: DEBUG oslo_concurrency.processutils [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=74812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_concurrency.processutils [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] CMD "cinder-rtstool verify" returned: 0 in 1.190s {{(pid=74812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_db.sqlalchemy.engines [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74812) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 11:14:57 devstack cinder-volume[74812]: INFO cinder.rpc [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 10 11:14:57 devstack cinder-volume[74812]: INFO cinder.rpc [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 10 11:14:57 devstack cinder-volume[74812]: WARNING stevedore.named [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 10 11:14:57 devstack cinder-volume[74812]: WARNING castellan.key_manager [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 10 11:14:57 devstack cinder-volume[74812]: INFO cinder.volume.manager [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_db.sqlalchemy.engines [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74812) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 11:14:57 devstack cinder-volume[74812]: INFO oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Starting 1 workers
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Started child 74948 {{(pid=74812) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Full set of CONF: {{(pid=74812) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] ******************************************************************************** {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Configuration options gathered from: {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] ================================================================================ {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] allow_availability_zone_fallback = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] allow_compression_on_image_upload = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] allowed_direct_url_schemes     = [] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] api_rate_limit                 = True {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] auth_strategy                  = keystone {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] az_cache_duration              = 3600 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_availability_zone      = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74948]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0)
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_host                   = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_name                   = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_stats_polling_interval = 60 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backup_api_class               = cinder.backup.api.API {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backup_name_template           = backup-%s {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backup_use_same_host           = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backup_use_temp_snapshot       = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] chap_password                  = **** {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] chap_username                  =  {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cinder_internal_tenant_project_id = 18720572f8844a5abf4fe4d6d939b802 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cinder_internal_tenant_user_id = 39339b619a3a4873b3c82ff5277ec38f {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cloned_volume_same_az          = True {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cluster                        = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] compression_format             = gzip {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] compute_api_class              = cinder.compute.nova.API {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] config_dir                     = [] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] config_source                  = [] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] control_exchange               = openstack {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] debug                          = True {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] default_availability_zone      = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] default_group_type             = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] default_volume_type            = lvmdriver-1 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] driver_client_cert             = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] driver_client_cert_key         = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] driver_data_namespace          = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] driver_ssl_cert_path           = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] driver_ssl_cert_verify         = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] driver_use_ssl                 = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] enable_force_upload            = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] enable_new_services            = True {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] enable_unsupported_driver      = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] enforce_multipath_for_image_xfer = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] filter_function                = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] glance_api_insecure            = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] glance_api_servers             = ['http://192.168.122.211/image'] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] glance_api_ssl_compression     = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] glance_ca_certificates_file    = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] glance_catalog_info            = image:glance:publicURL {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] glance_certfile                = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] glance_keyfile                 = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] glance_num_retries             = 3 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] glance_request_timeout         = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] goodness_function              = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] graceful_shutdown_timeout      = 5 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] group_api_class                = cinder.group.api.API {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] host                           = devstack {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] image_compress_on_upload       = True {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] image_conversion_address_space_limit = 1 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] image_conversion_cpu_limit     = 60 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] image_conversion_disable       = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] image_upload_use_cinder_backend = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] image_upload_use_internal_tenant = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] image_volume_cache_enabled     = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] image_volume_cache_max_count   = 0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] image_volume_cache_max_size_gb = 0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] init_host_max_objects_retrieval = 0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] iscsi_iotype                   = fileio {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] iscsi_target_flags             =  {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] iscsi_write_cache              = on {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] iser_helper                    = tgtadm {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:57 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] iser_ip_address                = 192.168.122.211 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] iser_port                      = 3260 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] log_color                      = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] log_config_append              = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] log_dir                        = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] log_file                       = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] log_options                    = True {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] log_rotate_interval            = 1 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] log_rotate_interval_type       = days {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] log_rotation_type              = none {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] max_age                        = 0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] max_logfile_count              = 30 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] max_logfile_size_mb            = 200 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] max_over_subscription_ratio    = 20.0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] message_reap_interval          = 86400 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] message_ttl                    = 2592000 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] migration_create_volume_timeout_secs = 300 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] monkey_patch                   = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] monkey_patch_modules           = [] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] my_ip                          = 192.168.122.211 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] no_snapshot_gb_quota           = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] num_iser_scan_tries            = 3 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] num_shell_tries                = 3 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] num_volume_device_scan_tries   = 3 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] nvmeof_conn_info_version       = 1 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] nvmet_ns_id                    = 10 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] nvmet_port_id                  = 1 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] osapi_max_limit                = 1000 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] osapi_volume_ext_list          = [] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] osapi_volume_listen_port       = 8776 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] osapi_volume_use_ssl           = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] osapi_volume_workers           = 2 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] per_volume_size_limit          = -1 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] periodic_fuzzy_delay           = 60 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] periodic_interval              = 60 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] public_endpoint                = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] publish_errors                 = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] quota_backup_gigabytes         = 1000 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] quota_backups                  = 10 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] quota_gigabytes                = 1000 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] quota_groups                   = 10 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] quota_snapshots                = 10 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] quota_volumes                  = 10 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] rate_limit_burst               = 0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] rate_limit_except_level        = CRITICAL {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] rate_limit_interval            = 0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] reinit_driver_count            = 3 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] replication_device             = **** {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] report_discard_supported       = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] report_interval                = 120 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] reservation_clean_interval     = 86400 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] reservation_expire             = 86400 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] reserved_image_namespaces      = [] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] reserved_percentage            = 0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] rpc_response_timeout           = 120 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] run_external_periodic_tasks    = True {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] scst_target_driver             = iscsi {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] scst_target_iqn_name           = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] service_down_time              = 720 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] shell_completion               = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] snapshot_name_template         = snapshot-%s {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] snapshot_same_host             = True {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] split_loggers                  = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] state_path                     = /opt/stack/data/cinder {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] storage_availability_zone      = nova {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] storage_protocol               = iSCSI {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] syslog_log_facility            = LOG_USER {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] target_helper                  = lioadm {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] target_ip_address              = 192.168.122.211 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] target_port                    = 3260 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] target_protocol                = iscsi {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] target_secondary_ip_addresses  = [] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] trace_flags                    = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] transport_url                  = **** {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] until_refresh                  = 0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] use_chap_auth                  = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] use_default_quota_class        = True {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] use_journal                    = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] use_json                       = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] use_multipath_for_image_xfer   = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] use_stderr                     = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] use_syslog                     = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] verify_glance_signatures       = enabled {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] volume_api_class               = cinder.volume.api.API {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] volume_backend_name            = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] volume_clear                   = zero {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] volume_clear_ionice            = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] volume_clear_size              = 0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] volume_copy_bps_limit          = 0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] volume_dd_blocksize            = 1M {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] volume_name_template           = volume-%s {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] volume_service_inithost_offload = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] volume_usage_audit_period      = month {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] watch_log_file                 = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] zoning_mode                    = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_concurrency.disable_process_locking = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.admin_password = **** {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.admin_token = **** {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.admin_user  = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.auth_port   = 35357 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.auth_protocol = https {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.auth_section = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.auth_type   = password {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.auth_uri    = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.auth_version = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.cache       = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.certfile    = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.delay_auth_decision = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.http_connect_timeout = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.identity_uri = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.include_service_catalog = True {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.insecure    = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.interface   = public {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.keyfile     = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.memcache_password =  {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.memcache_username =  {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.region_name = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.service_token_roles_required = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.service_type = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.token_cache_time = 300 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.backend                  = dogpile.cache.null {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.backend_argument         = **** {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.backend_expiration_time  = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.config_prefix            = cache.oslo {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.dead_timeout             = 60.0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.debug_cache_backend      = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.enable_retry_client      = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.enable_socket_keepalive  = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.enabled                  = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.enforce_fips_mode        = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.expiration_time          = 600 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.hashclient_retry_attempts = 2 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.memcache_dead_retry      = 300 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.memcache_password        = **** {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.memcache_sasl_enabled    = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.memcache_username        = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.proxies                  = [] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.redis_db                 = 0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.redis_password           = **** {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.redis_sentinel_service_name = mymaster {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.redis_server             = localhost:6379 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.redis_socket_timeout     = 1.0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.redis_username           = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.retry_attempts           = 2 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.retry_delay              = 0.0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.socket_keepalive_count   = 1 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.socket_keepalive_idle    = 1 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.socket_keepalive_interval = 1 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.tls_allowed_ciphers      = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.tls_cafile               = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.tls_certfile             = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.tls_enabled              = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cache.tls_keyfile              = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] coordination.backend_url       = **** {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] database.asyncio_connection    = **** {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] database.asyncio_slave_connection = **** {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] database.backend               = sqlalchemy {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] database.connection            = **** {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] database.connection_debug      = 0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] database.connection_parameters =  {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] database.connection_recycle_time = 3600 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] database.connection_trace      = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] database.db_inc_retry_interval = True {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] database.db_max_retries        = 20 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] database.db_max_retry_interval = 10 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] database.db_retry_interval     = 1 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] database.max_overflow          = 50 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] database.max_pool_size         = 5 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] database.max_retries           = 10 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] database.mysql_wsrep_sync_wait = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] database.pool_timeout          = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] database.retry_interval        = 10 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] database.slave_connection      = **** {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] database.sqlite_synchronous    = True {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] database.use_db_reconnect      = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] profiler.connection_string     = messaging:// {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] profiler.enabled               = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] profiler.es_doc_type           = notification {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] profiler.es_scroll_size        = 10000 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] profiler.es_scroll_time        = 2m {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] profiler.filter_error_trace    = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] profiler.hmac_keys             = **** {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] profiler.sentinel_service_name = mymaster {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] profiler.socket_timeout        = 0.1 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] profiler.trace_requests        = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] profiler.trace_sqlalchemy      = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] profiler_jaeger.process_tags   = {} {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] profiler_jaeger.service_name_prefix = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] profiler_otlp.service_name_prefix = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_policy.enforce_new_defaults = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: WARNING oslo_config.cfg [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_policy.enforce_scope      = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_policy.policy_default_rule = default {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] privsep_osbrick.group          = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] privsep_osbrick.helper_command = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74948]: INFO cinder.volume.manager [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] privsep_osbrick.user           = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cinder_sys_admin.group         = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cinder_sys_admin.helper_command = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] cinder_sys_admin.user          = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] service_user.auth_section      = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] service_user.auth_type         = password {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] service_user.certfile          = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] service_user.collect_timing    = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] service_user.insecure          = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] service_user.keyfile           = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] service_user.send_service_user_token = True {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] service_user.split_loggers     = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] service_user.timeout           = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] glance.auth_section            = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] glance.auth_type               = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] glance.cafile                  = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] glance.certfile                = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] glance.collect_timing          = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] glance.insecure                = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] glance.keyfile                 = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] glance.split_loggers           = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] glance.timeout                 = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.backend_availability_zone = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.chap_password = **** {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.chap_username =  {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.driver_client_cert = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.driver_client_cert_key = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.driver_data_namespace = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.driver_use_ssl = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.enable_unsupported_driver = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.extra_capabilities = {} {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.filter_function = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.goodness_function = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.iscsi_target_flags =  {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.iscsi_write_cache = on {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.iser_helper   = tgtadm {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.iser_ip_address = 192.168.122.211 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.iser_port     = 3260 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.lvm_share_target = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.lvm_type      = auto {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.num_shell_tries = 3 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.nvmet_port_id = 1 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.replication_device = **** {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.report_discard_supported = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.reserved_percentage = 0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.scst_target_driver = iscsi {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.scst_target_iqn_name = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.storage_protocol = iSCSI {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.target_helper = tgtadm {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.target_ip_address = 192.168.122.211 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.target_port   = 3260 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.target_protocol = iscsi {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.trace_flags   = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.unique_fqdn_network = True {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.use_chap_auth = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.volume_backend_name = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.volume_clear  = zero {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.volume_clear_ionice = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.volume_clear_size = 0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_reports.file_event_handler = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_reports.log_dir           = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.backend_availability_zone = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.backend_host       = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.chap_password      = **** {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.chap_username      = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.driver_client_cert = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.driver_data_namespace = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.extra_capabilities = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.filter_function    = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.goodness_function  = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.iscsi_iotype       = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.iser_helper        = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.iser_ip_address    = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.iser_port          = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.iser_target_prefix = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.lvm_share_target   = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.lvm_type           = auto {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.num_shell_tries    = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.replication_device = **** {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.report_discard_supported = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.reserved_percentage = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.scst_target_driver = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.storage_protocol   = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.target_helper      = lioadm {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.target_ip_address  = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.target_port        = 3260 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.trace_flags        = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.use_chap_auth      = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.volume_clear       = zero {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.volume_clear_size  = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] lvmdriver-1.volumes_dir        = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.270s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_notifications.driver = [] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_notifications.retry = -1 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] key_manager.fixed_key          = **** {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] barbican.barbican_api_version  = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] barbican.barbican_endpoint     = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] barbican.barbican_endpoint_type = public {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] barbican.barbican_region_name  = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] barbican.cafile                = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] barbican.certfile              = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] barbican.collect_timing        = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] barbican.insecure              = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] barbican.keyfile               = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] barbican.number_of_retries     = 60 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] barbican.retry_delay           = 1 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] barbican.send_service_user_token = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] barbican.split_loggers         = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] barbican.timeout               = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] barbican.verify_ssl            = True {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] barbican.verify_ssl_path       = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] barbican_service_user.auth_section = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] barbican_service_user.auth_type = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] barbican_service_user.cafile   = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] barbican_service_user.certfile = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] barbican_service_user.collect_timing = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] barbican_service_user.insecure = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] barbican_service_user.keyfile  = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] barbican_service_user.split_loggers = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] barbican_service_user.timeout  = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] vault.approle_role_id          = **** {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] vault.approle_secret_id        = **** {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] vault.kv_mountpoint            = secret {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] vault.kv_path                  = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] vault.kv_version               = 2 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] vault.namespace                = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] vault.root_token_id            = **** {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] vault.ssl_ca_crt_file          = None {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] vault.timeout                  = 60.0 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] vault.use_ssl                  = False {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:14:58 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] ******************************************************************************** {{(pid=74812) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 10 11:14:58 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.121s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:14:58 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:14:58 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.139s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:14:58 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:14:59 devstack sudo[74995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 10 11:14:59 devstack sudo[74995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:15:01 devstack sudo[74995]: pam_unix(sudo:session): session closed for user root
Sep 10 11:15:01 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 2.270s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:01 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:01 devstack sudo[75121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 11:15:01 devstack sudo[75121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:15:03 devstack sudo[75121]: pam_unix(sudo:session): session closed for user root
Sep 10 11:15:03 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 2.110s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:03 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 11:15:03 devstack cinder-volume[74948]: INFO cinder.brick.local_dev.lvm [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 10 11:15:03 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:03 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.081s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:03 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:03 devstack sudo[75242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 11:15:03 devstack sudo[75242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:15:05 devstack sudo[75242]: pam_unix(sudo:session): session closed for user root
Sep 10 11:15:05 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.989s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:05 devstack cinder-volume[74948]: DEBUG cinder.brick.local_dev.lvm [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=74948) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Sep 10 11:15:05 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:05 devstack sudo[75328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 11:15:05 devstack sudo[75328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:15:07 devstack cinder-volume[74812]: DEBUG dbcounter [-] [74812] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:15:09 devstack sudo[75328]: pam_unix(sudo:session): session closed for user root
Sep 10 11:15:09 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 4.040s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:09 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:09 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.088s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:09 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:09 devstack sudo[75533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 11:15:09 devstack sudo[75533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:15:11 devstack sudo[75533]: pam_unix(sudo:session): session closed for user root
Sep 10 11:15:11 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.170s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:11 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:12 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.123s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:12 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:12 devstack sudo[75570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 10 11:15:12 devstack sudo[75570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:15:14 devstack sudo[75570]: pam_unix(sudo:session): session closed for user root
Sep 10 11:15:14 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.267s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:14 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:14 devstack sudo[75606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 11:15:14 devstack sudo[75606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:15:17 devstack sudo[75606]: pam_unix(sudo:session): session closed for user root
Sep 10 11:15:17 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.958s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:17 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:17 devstack sudo[75662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 11:15:17 devstack sudo[75662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:15:20 devstack sudo[75662]: pam_unix(sudo:session): session closed for user root
Sep 10 11:15:20 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.904s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:20 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:20 devstack sudo[75673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 11:15:20 devstack sudo[75673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:15:23 devstack sudo[75673]: pam_unix(sudo:session): session closed for user root
Sep 10 11:15:23 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 3.477s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:23 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:24 devstack sudo[75678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 11:15:24 devstack sudo[75678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:15:27 devstack sudo[75678]: pam_unix(sudo:session): session closed for user root
Sep 10 11:15:27 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.213s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:27 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:27 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.090s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:27 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:27 devstack sudo[75708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 11:15:27 devstack sudo[75708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:15:29 devstack sudo[75708]: pam_unix(sudo:session): session closed for user root
Sep 10 11:15:29 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.000s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:29 devstack cinder-volume[74948]: INFO cinder.volume.drivers.lvm [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 10 11:15:29 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:29 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.187s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:29 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:29 devstack sudo[75802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 11:15:29 devstack sudo[75802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:15:31 devstack sudo[75802]: pam_unix(sudo:session): session closed for user root
Sep 10 11:15:31 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.916s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:31 devstack cinder-volume[74948]: DEBUG cinder.volume.drivers.lvm [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Updating volume stats {{(pid=74948) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 11:15:31 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:31 devstack sudo[75942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 11:15:31 devstack sudo[75942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:15:33 devstack sudo[75942]: pam_unix(sudo:session): session closed for user root
Sep 10 11:15:33 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.048s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:33 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:33 devstack sudo[75945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 11:15:33 devstack sudo[75945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:15:35 devstack sudo[75945]: pam_unix(sudo:session): session closed for user root
Sep 10 11:15:35 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.011s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:35 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:35 devstack sudo[75949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 11:15:35 devstack sudo[75949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:15:37 devstack sudo[75949]: pam_unix(sudo:session): session closed for user root
Sep 10 11:15:37 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.132s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:37 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:37 devstack sudo[75955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 11:15:37 devstack sudo[75955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:15:39 devstack sudo[75955]: pam_unix(sudo:session): session closed for user root
Sep 10 11:15:39 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.957s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:39 devstack cinder-volume[74948]: INFO cinder.volume.driver [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Driver hasn't implemented _init_vendor_properties()
Sep 10 11:15:39 devstack cinder-volume[74948]: DEBUG cinder.volume.driver [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=74948) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 10 11:15:39 devstack cinder-volume[74948]: DEBUG oslo_db.sqlalchemy.engines [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74948) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 11:15:39 devstack cinder-volume[74948]: DEBUG dbcounter [-] [74948] Writer thread running {{(pid=74948) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 10 11:15:39 devstack cinder-volume[74948]: DEBUG cinder.db.sqlalchemy.api [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Building query based on filter {{(pid=74948) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 10 11:15:40 devstack cinder-volume[74948]: DEBUG cinder.image.image_utils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=74948) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 10 11:15:40 devstack cinder-volume[74948]: INFO cinder.keymgr.migration [None req-d9fa9813-f30f-49f2-bcc7-7ac101fc115d None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 10 11:15:40 devstack cinder-volume[74948]: DEBUG cinder.volume.drivers.lvm [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Updating volume stats {{(pid=74948) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 11:15:40 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:40 devstack sudo[75960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 11:15:40 devstack sudo[75960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:15:42 devstack sudo[75960]: pam_unix(sudo:session): session closed for user root
Sep 10 11:15:42 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.192s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:42 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:42 devstack sudo[76063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 11:15:42 devstack sudo[76063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:15:44 devstack sudo[76063]: pam_unix(sudo:session): session closed for user root
Sep 10 11:15:44 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.080s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:44 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:44 devstack sudo[76108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 11:15:44 devstack sudo[76108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:15:46 devstack sudo[76108]: pam_unix(sudo:session): session closed for user root
Sep 10 11:15:46 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.237s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:46 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:46 devstack sudo[76143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 11:15:46 devstack sudo[76143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:15:48 devstack sudo[76143]: pam_unix(sudo:session): session closed for user root
Sep 10 11:15:48 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.897s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:48 devstack cinder-volume[74948]: DEBUG cinder.manager [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Notifying Schedulers of capabilities ... {{(pid=74948) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:15:48 devstack cinder-volume[74948]: INFO cinder.volume.manager [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Driver initialization completed successfully.
Sep 10 11:15:48 devstack cinder-volume[74948]: INFO cinder.manager [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Initiating service 2 cleanup
Sep 10 11:15:48 devstack cinder-volume[74948]: INFO cinder.manager [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Service 2 cleanup completed.
Sep 10 11:15:48 devstack cinder-volume[74948]: DEBUG cinder.service [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Creating RPC server for service cinder-volume {{(pid=74948) start /opt/stack/cinder/cinder/service.py:239}}
Sep 10 11:15:48 devstack cinder-volume[74948]: DEBUG cinder.service [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=74948) start /opt/stack/cinder/cinder/service.py:245}}
Sep 10 11:15:49 devstack cinder-volume[74948]: INFO cinder.volume.manager [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 10 11:15:49 devstack cinder-volume[74948]: DEBUG cinder.volume.drivers.lvm [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Updating volume stats {{(pid=74948) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 11:15:49 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:49 devstack sudo[76146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 11:15:49 devstack sudo[76146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:15:51 devstack sudo[76146]: pam_unix(sudo:session): session closed for user root
Sep 10 11:15:51 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.031s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:51 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:51 devstack sudo[76154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 11:15:51 devstack sudo[76154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:15:53 devstack sudo[76154]: pam_unix(sudo:session): session closed for user root
Sep 10 11:15:53 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.097s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:53 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:53 devstack sudo[76157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 11:15:53 devstack sudo[76157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:15:55 devstack sudo[76157]: pam_unix(sudo:session): session closed for user root
Sep 10 11:15:55 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.092s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:55 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:15:55 devstack sudo[76165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 11:15:55 devstack sudo[76165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:15:57 devstack sudo[76165]: pam_unix(sudo:session): session closed for user root
Sep 10 11:15:57 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.855s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:15:57 devstack cinder-volume[74948]: INFO cinder.volume.manager [None req-82044227-a451-4a49-9746-0bcf8375d7c1 None None] Driver post RPC initialization completed successfully.
Sep 10 11:15:58 devstack cinder-volume[74948]: DEBUG dbcounter [-] [74948] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74948) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:16:07 devstack cinder-volume[74948]: DEBUG dbcounter [-] [74948] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=74948) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:16:46 devstack cinder-volume[74948]: DEBUG oslo_service.periodic_task [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74948) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:16:46 devstack cinder-volume[74948]: DEBUG cinder.volume.drivers.lvm [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Updating volume stats {{(pid=74948) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 11:16:46 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:16:46 devstack sudo[77152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 11:16:46 devstack sudo[77152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:16:48 devstack sudo[77152]: pam_unix(sudo:session): session closed for user root
Sep 10 11:16:48 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.058s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:16:48 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:16:48 devstack sudo[77157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 11:16:48 devstack sudo[77157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:16:50 devstack sudo[77157]: pam_unix(sudo:session): session closed for user root
Sep 10 11:16:50 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.980s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:16:50 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:16:50 devstack sudo[77231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 11:16:50 devstack sudo[77231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:16:52 devstack sudo[77231]: pam_unix(sudo:session): session closed for user root
Sep 10 11:16:52 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.009s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:16:52 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:16:52 devstack sudo[77348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 11:16:52 devstack sudo[77348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:16:54 devstack sudo[77348]: pam_unix(sudo:session): session closed for user root
Sep 10 11:16:54 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.977s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:16:54 devstack cinder-volume[74948]: DEBUG cinder.manager [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Notifying Schedulers of capabilities ... {{(pid=74948) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:17:46 devstack cinder-volume[74948]: DEBUG oslo_service.periodic_task [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74948) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:17:46 devstack cinder-volume[74948]: DEBUG cinder.volume.drivers.lvm [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Updating volume stats {{(pid=74948) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 11:17:46 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:17:46 devstack sudo[77897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 11:17:46 devstack sudo[77897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:17:48 devstack sudo[77897]: pam_unix(sudo:session): session closed for user root
Sep 10 11:17:48 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.227s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:17:48 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:17:48 devstack sudo[77959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 11:17:48 devstack sudo[77959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:17:50 devstack sudo[77959]: pam_unix(sudo:session): session closed for user root
Sep 10 11:17:50 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.136s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:17:50 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:17:50 devstack sudo[77962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 11:17:50 devstack sudo[77962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:17:52 devstack sudo[77962]: pam_unix(sudo:session): session closed for user root
Sep 10 11:17:52 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.998s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:17:52 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:17:52 devstack sudo[77965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 11:17:52 devstack sudo[77965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:17:54 devstack sudo[77965]: pam_unix(sudo:session): session closed for user root
Sep 10 11:17:54 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.949s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:17:54 devstack cinder-volume[74948]: DEBUG cinder.manager [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Notifying Schedulers of capabilities ... {{(pid=74948) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:18:07 devstack cinder-volume[74948]: DEBUG dbcounter [-] [74948] Writing DB stats cinder:SELECT=1 {{(pid=74948) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:18:07 devstack cinder-volume[74948]: DEBUG dbcounter [-] [74948] Writing DB stats cinder:UPDATE=1 {{(pid=74948) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:18:46 devstack cinder-volume[74948]: DEBUG oslo_service.periodic_task [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74948) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:18:46 devstack cinder-volume[74948]: DEBUG cinder.volume.drivers.lvm [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Updating volume stats {{(pid=74948) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 11:18:46 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:18:46 devstack sudo[80256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 11:18:46 devstack sudo[80256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:18:48 devstack sudo[80256]: pam_unix(sudo:session): session closed for user root
Sep 10 11:18:48 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.060s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:18:48 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:18:48 devstack sudo[80403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 11:18:48 devstack sudo[80403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:18:50 devstack sudo[80403]: pam_unix(sudo:session): session closed for user root
Sep 10 11:18:50 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.412s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:18:50 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:18:51 devstack sudo[80584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 11:18:51 devstack sudo[80584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:18:52 devstack sudo[80584]: pam_unix(sudo:session): session closed for user root
Sep 10 11:18:53 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.018s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:18:53 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:18:53 devstack sudo[80729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 11:18:53 devstack sudo[80729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:18:55 devstack sudo[80729]: pam_unix(sudo:session): session closed for user root
Sep 10 11:18:55 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.003s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:18:55 devstack cinder-volume[74948]: DEBUG cinder.manager [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Notifying Schedulers of capabilities ... {{(pid=74948) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:19:46 devstack cinder-volume[74948]: DEBUG oslo_service.periodic_task [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74948) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:19:46 devstack cinder-volume[74948]: DEBUG cinder.volume.drivers.lvm [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Updating volume stats {{(pid=74948) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 11:19:46 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:19:46 devstack sudo[81187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 11:19:46 devstack sudo[81187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:19:48 devstack sudo[81187]: pam_unix(sudo:session): session closed for user root
Sep 10 11:19:48 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.000s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:19:48 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:19:48 devstack sudo[81192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 11:19:48 devstack sudo[81192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:19:50 devstack sudo[81192]: pam_unix(sudo:session): session closed for user root
Sep 10 11:19:50 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.190s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:19:50 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:19:50 devstack sudo[81205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 11:19:50 devstack sudo[81205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:19:52 devstack sudo[81205]: pam_unix(sudo:session): session closed for user root
Sep 10 11:19:53 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.295s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:19:53 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:19:53 devstack sudo[81235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 11:19:53 devstack sudo[81235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:19:54 devstack sudo[81235]: pam_unix(sudo:session): session closed for user root
Sep 10 11:19:54 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.877s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:19:54 devstack cinder-volume[74948]: DEBUG cinder.manager [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Notifying Schedulers of capabilities ... {{(pid=74948) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:20:07 devstack cinder-volume[74948]: DEBUG dbcounter [-] [74948] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=74948) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:20:46 devstack cinder-volume[74948]: DEBUG oslo_service.periodic_task [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74948) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:20:46 devstack cinder-volume[74948]: DEBUG cinder.volume.drivers.lvm [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Updating volume stats {{(pid=74948) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 11:20:46 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:20:46 devstack sudo[81393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 11:20:46 devstack sudo[81393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:20:48 devstack sudo[81393]: pam_unix(sudo:session): session closed for user root
Sep 10 11:20:48 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.945s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:20:48 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:20:48 devstack sudo[81399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 11:20:48 devstack sudo[81399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:20:50 devstack sudo[81399]: pam_unix(sudo:session): session closed for user root
Sep 10 11:20:50 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.917s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:20:50 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:20:50 devstack sudo[81408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 11:20:50 devstack sudo[81408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:20:52 devstack sudo[81408]: pam_unix(sudo:session): session closed for user root
Sep 10 11:20:52 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.910s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:20:52 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:20:52 devstack sudo[81431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 11:20:52 devstack sudo[81431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:20:54 devstack sudo[81431]: pam_unix(sudo:session): session closed for user root
Sep 10 11:20:54 devstack cinder-volume[74948]: DEBUG oslo_concurrency.processutils [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.940s {{(pid=74948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:20:54 devstack cinder-volume[74948]: DEBUG cinder.manager [None req-044a16ba-91ed-4a9c-8072-941d2ad278e8 None None] Notifying Schedulers of capabilities ... {{(pid=74948) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:21:36 devstack cinder-volume[74812]: INFO oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Caught SIGTERM, stopping children
Sep 10 11:21:36 devstack cinder-volume[74812]: DEBUG oslo_concurrency.lockutils [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Acquiring lock "singleton_lock" {{(pid=74812) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 10 11:21:36 devstack cinder-volume[74812]: DEBUG oslo_concurrency.lockutils [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Acquired lock "singleton_lock" {{(pid=74812) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 10 11:21:36 devstack cinder-volume[74812]: DEBUG oslo_concurrency.lockutils [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Releasing lock "singleton_lock" {{(pid=74812) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 10 11:21:36 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Stop services. {{(pid=74812) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Sep 10 11:21:36 devstack cinder-volume[74812]: DEBUG oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Killing children. {{(pid=74812) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Sep 10 11:21:36 devstack cinder-volume[74812]: INFO oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Waiting on 1 children to exit
Sep 10 11:21:39 devstack cinder-volume[74948]: DEBUG oslo_concurrency.lockutils [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Acquiring lock "singleton_lock" {{(pid=74948) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 10 11:21:39 devstack cinder-volume[74948]: DEBUG oslo_concurrency.lockutils [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Acquired lock "singleton_lock" {{(pid=74948) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 10 11:21:39 devstack cinder-volume[74948]: DEBUG oslo_concurrency.lockutils [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Releasing lock "singleton_lock" {{(pid=74948) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 10 11:21:39 devstack cinder-volume[74948]: WARNING amqp [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 10 11:21:39 devstack cinder-volume[74948]: WARNING amqp [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 10 11:21:39 devstack cinder-volume[74812]: INFO oslo_service.backend._eventlet.service [None req-1455e790-bd5f-4203-87b8-9468363c6425 None None] Child 74948 exited with status 0
Sep 10 11:21:56 devstack cinder-volume[82358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 10 11:21:56 devstack cinder-volume[82358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 10 11:21:56 devstack cinder-volume[82358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 10 11:21:59 devstack cinder-volume[82358]: INFO dbcounter [None req-9c30a984-788e-4312-a075-725be992c8db None None] Registered counter for database cinder
Sep 10 11:21:59 devstack cinder-volume[82358]: DEBUG oslo_db.sqlalchemy.engines [None req-9c30a984-788e-4312-a075-725be992c8db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82358) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 11:22:00 devstack cinder-volume[82358]: DEBUG dbcounter [-] [82358] Writer thread running {{(pid=82358) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 10 11:22:00 devstack cinder-volume[82358]: INFO cinder.rpc [None req-9c30a984-788e-4312-a075-725be992c8db None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 10 11:22:00 devstack cinder-volume[82358]: INFO cinder.rpc [None req-9c30a984-788e-4312-a075-725be992c8db None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 10 11:22:00 devstack cinder-volume[82358]: DEBUG oslo_db.sqlalchemy.engines [None req-9c30a984-788e-4312-a075-725be992c8db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82358) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 11:22:00 devstack cinder-volume[82358]: INFO cinder.volume.manager [None req-9c30a984-788e-4312-a075-725be992c8db None None] Determined volume DB was empty at startup.
Sep 10 11:22:00 devstack cinder-volume[82358]: DEBUG cinder.volume.manager [None req-9c30a984-788e-4312-a075-725be992c8db None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82358) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 10 11:22:00 devstack cinder-volume[82358]: INFO cinder.volume.manager [None req-9c30a984-788e-4312-a075-725be992c8db None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 10 11:22:00 devstack cinder-volume[82358]: WARNING stevedore.named [None req-9c30a984-788e-4312-a075-725be992c8db None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 10 11:22:00 devstack cinder-volume[82358]: WARNING castellan.key_manager [None req-9c30a984-788e-4312-a075-725be992c8db None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 10 11:22:00 devstack cinder-volume[82358]: WARNING cinder.keymgr.conf_key_mgr [None req-9c30a984-788e-4312-a075-725be992c8db None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 10 11:22:00 devstack cinder-volume[82358]: INFO cinder.volume.manager [None req-9c30a984-788e-4312-a075-725be992c8db None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 10 11:22:00 devstack cinder-volume[82358]: DEBUG oslo_db.sqlalchemy.engines [None req-9c30a984-788e-4312-a075-725be992c8db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82358) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 11:22:00 devstack cinder-volume[82358]: INFO oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] Starting 1 workers
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] Started child 82594 {{(pid=82358) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] Full set of CONF: {{(pid=82358) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] ******************************************************************************** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] Configuration options gathered from: {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] ================================================================================ {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] allow_availability_zone_fallback = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] allow_compression_on_image_upload = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] allowed_direct_url_schemes     = [] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] api_rate_limit                 = True {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] auth_strategy                  = keystone {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_availability_zone      = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_host                   = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_name                   = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_stats_polling_interval = 60 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82594]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0)
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backup_api_class               = cinder.backup.api.API {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backup_name_template           = backup-%s {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backup_use_same_host           = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backup_use_temp_snapshot       = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] chap_password                  = **** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] chap_username                  =  {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cinder_internal_tenant_project_id = 18720572f8844a5abf4fe4d6d939b802 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cinder_internal_tenant_user_id = 39339b619a3a4873b3c82ff5277ec38f {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cluster                        = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] compression_format             = gzip {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] compute_api_class              = cinder.compute.nova.API {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] config_dir                     = [] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] config_source                  = [] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] control_exchange               = openstack {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] debug                          = True {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] default_availability_zone      = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] default_group_type             = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] default_volume_type            = QuobyteHD {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] driver_client_cert             = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] driver_client_cert_key         = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] driver_data_namespace          = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] driver_ssl_cert_path           = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] driver_ssl_cert_verify         = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] driver_use_ssl                 = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] enable_new_services            = True {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] enable_unsupported_driver      = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] enabled_backends               = ['QuobyteHD'] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] enforce_multipath_for_image_xfer = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] filter_function                = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] glance_api_insecure            = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] glance_api_servers             = ['http://192.168.122.211/image'] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] glance_api_ssl_compression     = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] glance_ca_certificates_file    = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] glance_catalog_info            = image:glance:publicURL {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] glance_certfile                = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] glance_keyfile                 = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] glance_num_retries             = 3 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] glance_request_timeout         = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] goodness_function              = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] graceful_shutdown_timeout      = 5 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] group_api_class                = cinder.group.api.API {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] host                           = devstack {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] image_compress_on_upload       = True {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] image_conversion_address_space_limit = 1 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] image_conversion_cpu_limit     = 60 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] image_conversion_disable       = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] image_upload_use_cinder_backend = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] image_upload_use_internal_tenant = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] image_volume_cache_enabled     = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] image_volume_cache_max_count   = 0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] image_volume_cache_max_size_gb = 0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] init_host_max_objects_retrieval = 0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] instance_format                = [instance: %(uuid)s]  {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] iscsi_iotype                   = fileio {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] iscsi_target_flags             =  {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] iscsi_write_cache              = on {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] iser_helper                    = tgtadm {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] iser_ip_address                = 192.168.122.211 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] iser_port                      = 3260 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] log_color                      = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] log_config_append              = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] log_dir                        = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] log_file                       = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] log_options                    = True {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] log_rotate_interval            = 1 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] log_rotate_interval_type       = days {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] log_rotation_type              = none {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] max_age                        = 0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] max_logfile_count              = 30 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] max_logfile_size_mb            = 200 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] max_over_subscription_ratio    = 20.0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] message_reap_interval          = 86400 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] message_ttl                    = 2592000 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] migration_create_volume_timeout_secs = 300 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] monkey_patch                   = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] monkey_patch_modules           = [] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] my_ip                          = 192.168.122.211 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] no_snapshot_gb_quota           = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] num_iser_scan_tries            = 3 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] num_shell_tries                = 3 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] num_volume_device_scan_tries   = 3 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] nvmeof_conn_info_version       = 1 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] nvmet_ns_id                    = 10 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] nvmet_port_id                  = 1 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] osapi_max_limit                = 1000 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] osapi_volume_ext_list          = [] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] osapi_volume_listen_port       = 8776 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] osapi_volume_use_ssl           = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] osapi_volume_workers           = 2 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] per_volume_size_limit          = -1 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] periodic_fuzzy_delay           = 60 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] periodic_interval              = 60 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] public_endpoint                = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] publish_errors                 = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] quota_backup_gigabytes         = 1000 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] quota_backups                  = 10 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] quota_gigabytes                = 1000 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] quota_groups                   = 10 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] quota_snapshots                = 10 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] quota_volumes                  = 10 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] rate_limit_burst               = 0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] rate_limit_except_level        = CRITICAL {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] rate_limit_interval            = 0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] reinit_driver_count            = 3 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] replication_device             = **** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] report_discard_supported       = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] report_interval                = 120 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] reservation_clean_interval     = 86400 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] reservation_expire             = 86400 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] reserved_image_namespaces      = [] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] reserved_percentage            = 0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] rpc_response_timeout           = 120 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] run_external_periodic_tasks    = True {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] scst_target_driver             = iscsi {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] scst_target_iqn_name           = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] service_down_time              = 720 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] shell_completion               = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] snapshot_name_template         = snapshot-%s {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] split_loggers                  = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] state_path                     = /opt/stack/data/cinder {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] storage_availability_zone      = nova {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] storage_protocol               = iSCSI {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] syslog_log_facility            = LOG_USER {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] target_helper                  = lioadm {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] target_ip_address              = 192.168.122.211 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] target_port                    = 3260 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] target_protocol                = iscsi {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] target_secondary_ip_addresses  = [] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] trace_flags                    = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] transport_url                  = **** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] until_refresh                  = 0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] use_chap_auth                  = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] use_default_quota_class        = True {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] use_journal                    = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] use_json                       = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] use_multipath_for_image_xfer   = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] use_stderr                     = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] use_syslog                     = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] verify_glance_signatures       = enabled {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] volume_api_class               = cinder.volume.api.API {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] volume_backend_name            = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] volume_clear                   = zero {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] volume_clear_ionice            = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] volume_clear_size              = 0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] volume_copy_bps_limit          = 0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] volume_dd_blocksize            = 1M {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] volume_name_template           = volume-%s {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] volume_service_inithost_offload = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] volume_usage_audit_period      = month {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] watch_log_file                 = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] zoning_mode                    = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_concurrency.disable_process_locking = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.admin_password = **** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.admin_token = **** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.admin_user  = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.auth_port   = 35357 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.auth_protocol = https {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.auth_section = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.auth_type   = password {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.auth_uri    = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.auth_version = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.cache       = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.certfile    = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.delay_auth_decision = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.http_connect_timeout = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.identity_uri = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.include_service_catalog = True {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.insecure    = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.interface   = public {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.keyfile     = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.memcache_password =  {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.memcache_username =  {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.region_name = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.service_token_roles_required = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.service_type = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.token_cache_time = 300 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] keystone_authtoken.www_authenticate_uri = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.backend                  = dogpile.cache.null {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.backend_argument         = **** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.backend_expiration_time  = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.config_prefix            = cache.oslo {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.dead_timeout             = 60.0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.debug_cache_backend      = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.enable_retry_client      = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.enable_socket_keepalive  = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.enabled                  = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.enforce_fips_mode        = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.expiration_time          = 600 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.hashclient_retry_attempts = 2 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.hashclient_retry_delay   = 1.0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.memcache_dead_retry      = 300 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.memcache_password        = **** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.memcache_pool_maxsize    = 10 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.memcache_sasl_enabled    = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.memcache_socket_timeout  = 1.0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.memcache_username        = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.proxies                  = [] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.redis_db                 = 0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.redis_password           = **** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.redis_sentinel_service_name = mymaster {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.redis_server             = localhost:6379 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.redis_socket_timeout     = 1.0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.redis_username           = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.retry_attempts           = 2 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.retry_delay              = 0.0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.socket_keepalive_count   = 1 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.socket_keepalive_idle    = 1 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.socket_keepalive_interval = 1 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.tls_allowed_ciphers      = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.tls_cafile               = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.tls_certfile             = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.tls_enabled              = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cache.tls_keyfile              = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] coordination.backend_url       = **** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] database.asyncio_connection    = **** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] database.asyncio_slave_connection = **** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] database.backend               = sqlalchemy {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] database.connection            = **** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] database.connection_debug      = 0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] database.connection_parameters =  {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] database.connection_recycle_time = 3600 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] database.connection_trace      = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] database.db_inc_retry_interval = True {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] database.db_max_retries        = 20 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] database.db_max_retry_interval = 10 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] database.db_retry_interval     = 1 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] database.max_overflow          = 50 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] database.max_pool_size         = 5 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] database.max_retries           = 10 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] database.mysql_wsrep_sync_wait = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] database.pool_timeout          = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] database.retry_interval        = 10 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] database.slave_connection      = **** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] database.sqlite_synchronous    = True {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] database.use_db_reconnect      = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] profiler.connection_string     = messaging:// {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] profiler.enabled               = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] profiler.es_doc_type           = notification {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] profiler.es_scroll_size        = 10000 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] profiler.es_scroll_time        = 2m {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] profiler.filter_error_trace    = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] profiler.hmac_keys             = **** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] profiler.sentinel_service_name = mymaster {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] profiler.socket_timeout        = 0.1 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] profiler.trace_requests        = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] profiler.trace_sqlalchemy      = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] profiler_jaeger.process_tags   = {} {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] profiler_jaeger.service_name_prefix = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] profiler_otlp.service_name_prefix = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_policy.enforce_new_defaults = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: WARNING oslo_config.cfg [None req-9c30a984-788e-4312-a075-725be992c8db None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_policy.enforce_scope      = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_policy.policy_default_rule = default {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_policy.policy_file        = policy.yaml {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] privsep_osbrick.group          = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] privsep_osbrick.helper_command = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] privsep_osbrick.thread_pool_size = 3 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] privsep_osbrick.user           = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cinder_sys_admin.group         = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cinder_sys_admin.helper_command = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] cinder_sys_admin.user          = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] service_user.auth_section      = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] service_user.auth_type         = password {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] service_user.certfile          = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] service_user.collect_timing    = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] service_user.insecure          = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] service_user.keyfile           = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] service_user.send_service_user_token = True {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] service_user.split_loggers     = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] service_user.timeout           = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] glance.auth_section            = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] glance.auth_type               = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] glance.cafile                  = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] glance.certfile                = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] glance.collect_timing          = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] glance.insecure                = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] glance.keyfile                 = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] glance.split_loggers           = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] glance.timeout                 = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.backend_availability_zone = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.chap_password = **** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.chap_username =  {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.driver_client_cert = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.driver_client_cert_key = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.driver_data_namespace = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.driver_use_ssl = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.enable_unsupported_driver = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.extra_capabilities = {} {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.filter_function = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.goodness_function = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.iscsi_iotype  = fileio {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.iscsi_target_flags =  {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.iscsi_write_cache = on {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.iser_helper   = tgtadm {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.iser_ip_address = 192.168.122.211 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.iser_port     = 3260 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.nas_host      =  {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.nas_login     = admin {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.nas_mount_options = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.nas_password  = **** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.nas_private_key =  {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.nas_share_path =  {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.num_shell_tries = 3 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.nvmet_port_id = 1 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.quobyte_client_cfg = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:01 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Starting volume driver QuobyteDriver (1.1.13)
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.quobyte_volume_url = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.replication_device = **** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.report_discard_supported = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.reserved_percentage = 0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=82594) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.scst_target_driver = iscsi {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.scst_target_iqn_name = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.storage_protocol = iSCSI {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.target_helper = tgtadm {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.target_ip_address = 192.168.122.211 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.target_port   = 3260 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.target_protocol = iscsi {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.trace_flags   = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.unique_fqdn_network = True {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.use_chap_auth = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.volume_backend_name = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.volume_clear  = zero {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.volume_clear_ionice = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.volume_clear_size = 0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_reports.file_event_handler = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_reports.log_dir           = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.backend_availability_zone = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.backend_host         = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.chap_password        = **** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.chap_username        = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.chiscsi_conf         = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.driver_client_cert   = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.driver_client_cert_key = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.driver_data_namespace = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.driver_use_ssl       = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.extra_capabilities   = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.filter_function      = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.goodness_function    = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.iscsi_iotype         = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.iser_helper          = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.iser_ip_address      = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.iser_port            = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.iser_target_prefix   = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.nas_host             = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.nas_login            = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.nas_mount_options    = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.nas_password         = **** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.nas_private_key      = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.nas_secure_file_operations = true {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.nas_share_path       = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.nas_ssh_port         = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.num_shell_tries      = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.nvmet_port_id        = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.quobyte_volume_url   = quobyte://10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.replication_device   = **** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.report_discard_supported = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.reserved_percentage  = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.scst_target_driver   = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.storage_protocol     = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.target_helper        = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.target_ip_address    = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.target_port          = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.target_prefix        = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.target_protocol      = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.trace_flags          = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.use_chap_auth        = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.volume_clear         = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.volume_clear_size    = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] QuobyteHD.volumes_dir          = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.ssl      = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_notifications.driver = [] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_notifications.retry = -1 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] oslo_messaging_notifications.transport_url = **** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] key_manager.fixed_key          = **** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] barbican.barbican_api_version  = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] barbican.barbican_endpoint     = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] barbican.barbican_endpoint_type = public {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] barbican.barbican_region_name  = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] barbican.cafile                = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] barbican.certfile              = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] barbican.collect_timing        = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] barbican.insecure              = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] barbican.keyfile               = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] barbican.number_of_retries     = 60 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] barbican.retry_delay           = 1 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] barbican.send_service_user_token = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] barbican.split_loggers         = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] barbican.timeout               = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] barbican.verify_ssl            = True {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] barbican.verify_ssl_path       = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] barbican_service_user.auth_section = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] barbican_service_user.auth_type = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] barbican_service_user.cafile   = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] barbican_service_user.certfile = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] barbican_service_user.collect_timing = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] barbican_service_user.insecure = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] barbican_service_user.keyfile  = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] barbican_service_user.split_loggers = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] barbican_service_user.timeout  = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] vault.approle_role_id          = **** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] vault.approle_secret_id        = **** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] vault.kv_mountpoint            = secret {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] vault.kv_path                  = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] vault.kv_version               = 2 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] vault.namespace                = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] vault.root_token_id            = **** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] vault.ssl_ca_crt_file          = None {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] vault.timeout                  = 60.0 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] vault.use_ssl                  = False {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 11:22:02 devstack cinder-volume[82358]: DEBUG oslo_service.backend._eventlet.service [None req-9c30a984-788e-4312-a075-725be992c8db None None] ******************************************************************************** {{(pid=82358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 10 11:22:02 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=82594) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Sep 10 11:22:02 devstack cinder-volume[82594]: INFO cinder.volume.drivers.quobyte [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual.
Sep 10 11:22:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Running cmd (subprocess): mount.quobyte {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:22:02 devstack quobyte-client[82597]: Reading configuration file: /etc/quobyte/client.cfg
Sep 10 11:22:02 devstack quobyte-client[82597]: Invalid parameters found, error: missing mount point.
Sep 10 11:22:02 devstack quobyte-client[82597]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 10 11:22:02 devstack quobyte-client[82597]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Sep 10 11:22:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] CMD "mount.quobyte" returned: 1 in 0.423s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:22:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:22:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:22:02 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:22:02 devstack cinder-volume[82594]: INFO cinder.volume.drivers.quobyte [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Mounting volume: 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 ...
Sep 10 11:22:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf -c /etc/quobyte/client-cinder.cfg {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:22:03 devstack quobyte-client[82607]: Reading configuration file: /etc/quobyte/client-cinder.cfg
Sep 10 11:22:03 devstack quobyte-client[82607]: Reading configuration file: /etc/quobyte/client.cfg
Sep 10 11:22:03 devstack quobyte-client[82607]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf' to display the log.
Sep 10 11:22:03 devstack quobyte-client[82616]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic).
Sep 10 11:22:03 devstack quobyte-client[82616]: mount.quobyte 3.25 (4fbbd59204)
Sep 10 11:22:03 devstack quobyte-client[82616]: Client UUID: 6XYTOu5S-mSJx-Oe1e-A4IZ-Rz26OiqOLOvL
Sep 10 11:22:03 devstack quobyte-client[82616]: Registry: osci01.corp.quobyte.com:7861
Sep 10 11:22:03 devstack quobyte-client[82616]: Volume: cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:22:03 devstack quobyte-client[82616]: FUSE version: 316
Sep 10 11:22:03 devstack quobyte-client[82616]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps)
Sep 10 11:22:03 devstack quobyte-client[82616]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied
Sep 10 11:22:03 devstack quobyte-client[82616]: Setting total object cache size to 3352297472 bytes
Sep 10 11:22:03 devstack quobyte-client[82616]: Using FUSE low-level API
Sep 10 11:22:03 devstack quobyte-client[82616]: Caching of uid/gid to user/group name mappings is enabled
Sep 10 11:22:03 devstack quobyte-client[82616]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10
Sep 10 11:22:03 devstack quobyte-client[82616]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab.
Sep 10 11:22:03 devstack quobyte-client[82616]: HTTP server started on port 55000
Sep 10 11:22:03 devstack quobyte-client[82616]: Caching mappings from uid/gid to user/group name and group membership temporarily.
Sep 10 11:22:03 devstack quobyte-client[82616]: Mount point /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf established
Sep 10 11:22:03 devstack quobyte-client[82616]: TimeSync is running and remote sync every 60 seconds
Sep 10 11:22:03 devstack quobyte-client[82616]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 11:22:03 devstack quobyte-client[82616]: Ignored time synchronization message because time source took too long to respond (52 ms)
Sep 10 11:22:03 devstack quobyte-client[82616]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 11:22:03 devstack quobyte-client[82616]: Opening volume cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 (e8f724f4-479a-4f9b-ac4a-033479940815)
Sep 10 11:22:03 devstack quobyte-client[82616]: Setting metadata cache size to 500000 based on available system memory of 16 GiB
Sep 10 11:22:03 devstack quobyte-client[82616]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 11:22:03 devstack quobyte-client[82616]: Failed to invalidate inode: 38: Function not implemented
Sep 10 11:22:03 devstack quobyte-client[82616]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 11:22:03 devstack quobyte-client[82616]: Automatic minidump upload enabled by global system configuration
Sep 10 11:22:03 devstack quobyte-client[82616]: Announcing HTTP status server address 172.24.4.1
Sep 10 11:22:03 devstack quobyte-client[82616]: Registered as service (uuid 6XYTOu5S-mSJx-Oe1e-A4IZ-Rz26OiqOLOvL)
Sep 10 11:22:03 devstack quobyte-client[82616]: Quobyte Client running as pid 82616
Sep 10 11:22:03 devstack quobyte-client[82616]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2
Sep 10 11:22:03 devstack quobyte-client[82616]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl
Sep 10 11:22:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf -c /etc/quobyte/client-cinder.cfg" returned: 0 in 1.106s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:22:03 devstack cinder-volume[82594]: INFO cinder.volume.drivers.quobyte [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Mounting volume: 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 succeeded
Sep 10 11:22:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:22:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 1.173s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:22:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:22:04 devstack quobyte-client[82616]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 11:22:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.102s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:22:04 devstack cinder-volume[82594]: INFO cinder.volume.driver [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Driver hasn't implemented _init_vendor_properties()
Sep 10 11:22:04 devstack cinder-volume[82594]: DEBUG cinder.volume.driver [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.914478302002, 'free_capacity_gb': 924.914478302002, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82594) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 10 11:22:04 devstack cinder-volume[82594]: DEBUG oslo_db.sqlalchemy.engines [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82594) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 11:22:04 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writer thread running {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 10 11:22:04 devstack cinder-volume[82594]: DEBUG cinder.db.sqlalchemy.api [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Building query based on filter {{(pid=82594) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 10 11:22:04 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82594) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 10 11:22:04 devstack cinder-volume[82594]: INFO cinder.keymgr.migration [None req-29f8a351-60fc-4aa7-963a-1fea223f9a14 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 10 11:22:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:22:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:22:04 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:22:04 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:22:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:22:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:22:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.113s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:22:04 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:22:04 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Driver initialization completed successfully.
Sep 10 11:22:04 devstack cinder-volume[82594]: INFO cinder.manager [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Initiating service 3 cleanup
Sep 10 11:22:05 devstack cinder-volume[82594]: INFO cinder.manager [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Service 3 cleanup completed.
Sep 10 11:22:05 devstack cinder-volume[82594]: DEBUG cinder.service [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Creating RPC server for service cinder-volume {{(pid=82594) start /opt/stack/cinder/cinder/service.py:239}}
Sep 10 11:22:05 devstack cinder-volume[82594]: DEBUG cinder.service [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82594) start /opt/stack/cinder/cinder/service.py:245}}
Sep 10 11:22:05 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13)
Sep 10 11:22:05 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:22:05 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:22:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:22:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:22:05 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:22:05 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:22:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:22:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:22:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.106s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:22:05 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-42cf8a04-cda3-4129-9666-81ebf811c753 None None] Driver post RPC initialization completed successfully.
Sep 10 11:22:06 devstack quobyte-client[82616]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 11:22:10 devstack cinder-volume[82358]: DEBUG dbcounter [-] [82358] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82358) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:22:15 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:22:15 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:23:08 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:23:08 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:23:08 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Flow 'volume_create_manager' (7e2d688c-93c3-4d59-aee1-2e5ae562673b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:23:08 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa7467c-b477-498a-8785-16bc48c233b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:23:09 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa7467c-b477-498a-8785-16bc48c233b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1088015188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67e84527-8af3-44d2-891b-abce03b4b777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9688adf5da654c8fb7c9f99fd12be578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:23:08Z,use_quota=True,user_id='e3c0674860c846d3aec50931fcf72401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:23:09 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f1fe0a5-9407-42ed-ac37-e2689ae918b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:23:09 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f1fe0a5-9407-42ed-ac37-e2689ae918b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:23:09 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c21ba48-492d-4f84-9ac8-de08681dc8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:23:09 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c21ba48-492d-4f84-9ac8-de08681dc8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67e84527-8af3-44d2-891b-abce03b4b777', 'volume_name': 'volume-67e84527-8af3-44d2-891b-abce03b4b777', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:23:09 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d79023-0a75-4720-9e88-6cd09ad376af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:23:09 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d79023-0a75-4720-9e88-6cd09ad376af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:23:09 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a8a340b-8bad-4f84-bc72-0ca1dec16fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:23:09 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Volume 67e84527-8af3-44d2-891b-abce03b4b777: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67e84527-8af3-44d2-891b-abce03b4b777', 'volume_size': 1}
Sep 10 11:23:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:23:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:23:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1088015188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67e84527-8af3-44d2-891b-abce03b4b777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9688adf5da654c8fb7c9f99fd12be578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:23:08Z,use_quota=True,user_id='e3c0674860c846d3aec50931fcf72401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:23:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Creating volume 67e84527-8af3-44d2-891b-abce03b4b777 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:23:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:23:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:23:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:23:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:23:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:23:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:23:09 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:23:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-67e84527-8af3-44d2-891b-abce03b4b777 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:23:09 devstack quobyte-client[82616]: System call of process 82877 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:23:09 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=2, name=volume-67e84527-8af3-44d2-891b-abce03b4b777, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:23:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-67e84527-8af3-44d2-891b-abce03b4b777 1073741824" returned: 0 in 1.056s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:23:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-67e84527-8af3-44d2-891b-abce03b4b777 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:23:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-67e84527-8af3-44d2-891b-abce03b4b777" returned: 0 in 0.108s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:23:10 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] <== create_volume: return (1226ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:23:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:23:10 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a8a340b-8bad-4f84-bc72-0ca1dec16fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67e84527-8af3-44d2-891b-abce03b4b777', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:23:10 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea52f43e-2c7d-48fb-93d5-cb48dfcdf8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:23:10 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Volume volume-67e84527-8af3-44d2-891b-abce03b4b777 (67e84527-8af3-44d2-891b-abce03b4b777): created successfully
Sep 10 11:23:10 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea52f43e-2c7d-48fb-93d5-cb48dfcdf8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:23:10 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Flow 'volume_create_manager' (7e2d688c-93c3-4d59-aee1-2e5ae562673b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:23:10 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-4e89bb78-73d5-418d-b854-9a961a28ff10 tempest-TaggedAttachmentsTest-1630959102 None] Created volume successfully.
Sep 10 11:23:20 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:23:20 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:23:21 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:23:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:23:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:23:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:23:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:23:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:23:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:23:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.194s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:23:21 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:23:24 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:23:24 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:23:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Flow 'volume_create_manager' (080d9975-19b3-4f3d-908b-c2b10c6606c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:23:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640c6466-e808-4f5c-9def-8f8487b21771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:23:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640c6466-e808-4f5c-9def-8f8487b21771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-2001895292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb3cf2da-2d7c-4b79-923b-9563a0f3c853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ba16d91ff8456e98896e7d4399418d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:23:25Z,use_quota=True,user_id='1da02e22627c4a2192aa25cc01a7c740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:23:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5de54b-1544-491d-b9b8-e827e0ef589c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:23:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5de54b-1544-491d-b9b8-e827e0ef589c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:23:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (025954b2-0e54-48f3-8f54-1bf3734f7f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:23:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (025954b2-0e54-48f3-8f54-1bf3734f7f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb3cf2da-2d7c-4b79-923b-9563a0f3c853', 'volume_name': 'volume-bb3cf2da-2d7c-4b79-923b-9563a0f3c853', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:23:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab97095a-a4b9-4790-8a73-e9bfb638d547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:23:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab97095a-a4b9-4790-8a73-e9bfb638d547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:23:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b25ba8ea-ab68-45be-bbe8-3edcab8d4a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:23:25 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Volume bb3cf2da-2d7c-4b79-923b-9563a0f3c853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb3cf2da-2d7c-4b79-923b-9563a0f3c853', 'volume_size': 1}
Sep 10 11:23:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:23:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:23:25 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-2001895292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb3cf2da-2d7c-4b79-923b-9563a0f3c853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ba16d91ff8456e98896e7d4399418d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:23:25Z,use_quota=True,user_id='1da02e22627c4a2192aa25cc01a7c740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:23:25 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Creating volume bb3cf2da-2d7c-4b79-923b-9563a0f3c853 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:23:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:23:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:23:25 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:23:25 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:23:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:23:25 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:23:25 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:23:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bb3cf2da-2d7c-4b79-923b-9563a0f3c853 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:23:25 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=3, name=volume-bb3cf2da-2d7c-4b79-923b-9563a0f3c853, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:23:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bb3cf2da-2d7c-4b79-923b-9563a0f3c853 1073741824" returned: 0 in 0.455s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:23:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bb3cf2da-2d7c-4b79-923b-9563a0f3c853 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:23:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bb3cf2da-2d7c-4b79-923b-9563a0f3c853" returned: 0 in 0.161s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:23:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] <== create_volume: return (729ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:23:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:23:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b25ba8ea-ab68-45be-bbe8-3edcab8d4a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb3cf2da-2d7c-4b79-923b-9563a0f3c853', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:23:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e23c4a-ed0b-41ea-b2ed-587543378376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:23:26 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Volume volume-bb3cf2da-2d7c-4b79-923b-9563a0f3c853 (bb3cf2da-2d7c-4b79-923b-9563a0f3c853): created successfully
Sep 10 11:23:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e23c4a-ed0b-41ea-b2ed-587543378376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:23:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Flow 'volume_create_manager' (080d9975-19b3-4f3d-908b-c2b10c6606c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:23:26 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-617ba4ca-f9e5-4d8e-8ea9-227745d8fc3a tempest-VolumesAssistedSnapshotsTest-1016534801 None] Created volume successfully.
Sep 10 11:23:36 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:23:36 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:24:16 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:24:19 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:24:19 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:24:19 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Flow 'volume_create_manager' (20ee8230-a7ac-4271-8bad-db80cb670fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:24:19 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70def94e-3f2c-4c1b-948b-2282eb60e1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:24:19 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70def94e-3f2c-4c1b-948b-2282eb60e1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-46024097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4311e382-d161-4818-8b29-333ee3e33658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59f68ca488ae4b5d9bf6b2a5849a3e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:24:19Z,use_quota=True,user_id='2878ffac018a4bfd970687995d5b3a99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:24:19 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89df3e7-518b-4778-8a99-62c75ded2f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:24:19 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89df3e7-518b-4778-8a99-62c75ded2f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:24:19 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07b45df-dae6-42d6-a7dd-9a725cb03bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:24:19 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07b45df-dae6-42d6-a7dd-9a725cb03bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4311e382-d161-4818-8b29-333ee3e33658', 'volume_name': 'volume-4311e382-d161-4818-8b29-333ee3e33658', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:24:19 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d02b4c77-9f30-45f2-b309-c35e6eba39df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:24:19 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d02b4c77-9f30-45f2-b309-c35e6eba39df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:24:19 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a1ec21-3fab-44e6-80ad-e1b2641268e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:24:19 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Volume 4311e382-d161-4818-8b29-333ee3e33658: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4311e382-d161-4818-8b29-333ee3e33658', 'volume_size': 1}
Sep 10 11:24:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:24:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:24:19 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-46024097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4311e382-d161-4818-8b29-333ee3e33658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59f68ca488ae4b5d9bf6b2a5849a3e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:24:19Z,use_quota=True,user_id='2878ffac018a4bfd970687995d5b3a99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:24:19 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Creating volume 4311e382-d161-4818-8b29-333ee3e33658 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:24:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:24:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:24:19 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:24:19 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:24:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.210s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:24:19 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:24:19 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:24:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4311e382-d161-4818-8b29-333ee3e33658 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:24:20 devstack quobyte-client[82616]: System call of process 83548 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:24:20 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=4, name=volume-4311e382-d161-4818-8b29-333ee3e33658, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:24:21 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:24:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:24:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:24:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:24:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:24:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:24:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:24:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4311e382-d161-4818-8b29-333ee3e33658 1073741824" returned: 0 in 2.350s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:24:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4311e382-d161-4818-8b29-333ee3e33658 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:24:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.912s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:24:22 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:24:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4311e382-d161-4818-8b29-333ee3e33658" returned: 0 in 0.814s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:24:23 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] <== create_volume: return (3566ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:24:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.594s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:24:24 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a1ec21-3fab-44e6-80ad-e1b2641268e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4311e382-d161-4818-8b29-333ee3e33658', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:24:24 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b5aafd-f826-4e6d-a23f-865ea07c5201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:24:24 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Volume volume-4311e382-d161-4818-8b29-333ee3e33658 (4311e382-d161-4818-8b29-333ee3e33658): created successfully
Sep 10 11:24:24 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b5aafd-f826-4e6d-a23f-865ea07c5201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:24:24 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Flow 'volume_create_manager' (20ee8230-a7ac-4271-8bad-db80cb670fe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:24:24 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-1d0ee495-1cb5-465c-8c2e-47b50c60427d tempest-VolumesAdminNegativeTest-332028821 None] Created volume successfully.
Sep 10 11:24:26 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ad94982e-f474-4544-829a-1e427909ecf1 tempest-VolumesAdminNegativeTest-332028821 None] Acquiring lock "cinder-4311e382-d161-4818-8b29-333ee3e33658-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:24:26 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ad94982e-f474-4544-829a-1e427909ecf1 tempest-VolumesAdminNegativeTest-332028821 None] Lock "cinder-4311e382-d161-4818-8b29-333ee3e33658-delete_volume" acquired by "delete_volume" :: waited 0.154s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:24:26 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-ad94982e-f474-4544-829a-1e427909ecf1 tempest-VolumesAdminNegativeTest-332028821 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:24:26 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ad94982e-f474-4544-829a-1e427909ecf1 tempest-VolumesAdminNegativeTest-332028821 None] Acquiring lock "cinder-quobyte-4311e382-d161-4818-8b29-333ee3e33658" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:24:26 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ad94982e-f474-4544-829a-1e427909ecf1 tempest-VolumesAdminNegativeTest-332028821 None] Lock "cinder-quobyte-4311e382-d161-4818-8b29-333ee3e33658" acquired by "delete_volume" :: waited 0.037s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:24:26 devstack cinder-volume[82594]: INFO oslo.privsep.daemon [None req-ad94982e-f474-4544-829a-1e427909ecf1 tempest-VolumesAdminNegativeTest-332028821 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpa1cqo8hj/privsep.sock']
Sep 10 11:24:27 devstack sudo[83569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpa1cqo8hj/privsep.sock
Sep 10 11:24:27 devstack sudo[83569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:24:36 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:24:36 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:24:40 devstack sudo[83569]: pam_unix(sudo:session): session closed for user root
Sep 10 11:24:40 devstack cinder-volume[82594]: INFO oslo.privsep.daemon [None req-ad94982e-f474-4544-829a-1e427909ecf1 tempest-VolumesAdminNegativeTest-332028821 None] Spawned new privsep daemon via rootwrap
Sep 10 11:24:40 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [None req-ad94982e-f474-4544-829a-1e427909ecf1 tempest-VolumesAdminNegativeTest-332028821 None] Accepted privsep connection to /tmp/tmpa1cqo8hj/privsep.sock {{(pid=82594) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}}
Sep 10 11:24:40 devstack cinder-volume[82594]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 10 11:24:40 devstack cinder-volume[82594]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 10 11:24:40 devstack cinder-volume[82594]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 10 11:24:40 devstack cinder-volume[82594]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83617
Sep 10 11:24:40 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc54fa9-fe4e-4753-85b7-06a141ed2ebb]: (2,) {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:24:41 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfd6fd8-1eb2-4f26-ae76-a678dd622c5a]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:24:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ad94982e-f474-4544-829a-1e427909ecf1 tempest-VolumesAdminNegativeTest-332028821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4311e382-d161-4818-8b29-333ee3e33658 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:24:42 devstack quobyte-client[82616]: System call of process 83631 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:24:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ad94982e-f474-4544-829a-1e427909ecf1 tempest-VolumesAdminNegativeTest-332028821 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4311e382-d161-4818-8b29-333ee3e33658" returned: 0 in 1.544s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:24:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ad94982e-f474-4544-829a-1e427909ecf1 tempest-VolumesAdminNegativeTest-332028821 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4311e382-d161-4818-8b29-333ee3e33658 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:24:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ad94982e-f474-4544-829a-1e427909ecf1 tempest-VolumesAdminNegativeTest-332028821 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4311e382-d161-4818-8b29-333ee3e33658" returned: 0 in 0.230s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:24:43 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ad94982e-f474-4544-829a-1e427909ecf1 tempest-VolumesAdminNegativeTest-332028821 None] Lock "cinder-quobyte-4311e382-d161-4818-8b29-333ee3e33658" released by "delete_volume" :: held 16.593s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:24:44 devstack cinder-volume[82594]: WARNING cinder.quota [None req-ad94982e-f474-4544-829a-1e427909ecf1 tempest-VolumesAdminNegativeTest-332028821 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:24:44 devstack cinder-volume[82594]: WARNING cinder.quota [None req-ad94982e-f474-4544-829a-1e427909ecf1 tempest-VolumesAdminNegativeTest-332028821 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:24:44 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-ad94982e-f474-4544-829a-1e427909ecf1 tempest-VolumesAdminNegativeTest-332028821 None] Created reservations ['04c3eb04-8858-4c5e-b44e-33384507741b', '03b103c2-a0d3-4076-96b7-637a11235223', '36f7ea43-12af-4c9d-b739-dc497e894218', '2eb1fe5e-1cac-45ec-9be5-b8442f9a0585'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:24:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ad94982e-f474-4544-829a-1e427909ecf1 tempest-VolumesAdminNegativeTest-332028821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:24:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ad94982e-f474-4544-829a-1e427909ecf1 tempest-VolumesAdminNegativeTest-332028821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:24:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ad94982e-f474-4544-829a-1e427909ecf1 tempest-VolumesAdminNegativeTest-332028821 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:24:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ad94982e-f474-4544-829a-1e427909ecf1 tempest-VolumesAdminNegativeTest-332028821 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:24:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ad94982e-f474-4544-829a-1e427909ecf1 tempest-VolumesAdminNegativeTest-332028821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:24:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ad94982e-f474-4544-829a-1e427909ecf1 tempest-VolumesAdminNegativeTest-332028821 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:24:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ad94982e-f474-4544-829a-1e427909ecf1 tempest-VolumesAdminNegativeTest-332028821 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.222s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:24:45 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-ad94982e-f474-4544-829a-1e427909ecf1 tempest-VolumesAdminNegativeTest-332028821 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:24:45 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-ad94982e-f474-4544-829a-1e427909ecf1 tempest-VolumesAdminNegativeTest-332028821 None] Deleted volume successfully.
Sep 10 11:24:45 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ad94982e-f474-4544-829a-1e427909ecf1 tempest-VolumesAdminNegativeTest-332028821 None] Lock "cinder-4311e382-d161-4818-8b29-333ee3e33658-delete_volume" released by "delete_volume" :: held 19.330s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:24:54 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:24:55 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=4,cinder:INSERT=4,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:25:21 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:25:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:25:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:25:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:25:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:25:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:25:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:25:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.188s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:25:21 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:26:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-ecf93048-ac45-4527-9ba7-275a05a99a8a req-b92c4a57-0f84-40c1-ba97-a67a94a1d52d tempest-VolumesAssistedSnapshotsTest-1016534801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:26:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-ecf93048-ac45-4527-9ba7-275a05a99a8a req-b92c4a57-0f84-40c1-ba97-a67a94a1d52d tempest-VolumesAssistedSnapshotsTest-1016534801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:26:03 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[037a5ac9-0205-4883-a500-4938d46da50f]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:26:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-ecf93048-ac45-4527-9ba7-275a05a99a8a req-b92c4a57-0f84-40c1-ba97-a67a94a1d52d tempest-VolumesAssistedSnapshotsTest-1016534801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bb3cf2da-2d7c-4b79-923b-9563a0f3c853 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:26:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-ecf93048-ac45-4527-9ba7-275a05a99a8a req-b92c4a57-0f84-40c1-ba97-a67a94a1d52d tempest-VolumesAssistedSnapshotsTest-1016534801 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bb3cf2da-2d7c-4b79-923b-9563a0f3c853" returned: 0 in 0.545s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:26:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-ecf93048-ac45-4527-9ba7-275a05a99a8a req-b92c4a57-0f84-40c1-ba97-a67a94a1d52d tempest-VolumesAssistedSnapshotsTest-1016534801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.616s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:26:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-ecf93048-ac45-4527-9ba7-275a05a99a8a req-b92c4a57-0f84-40c1-ba97-a67a94a1d52d tempest-VolumesAssistedSnapshotsTest-1016534801 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56', 'name': 'volume-bb3cf2da-2d7c-4b79-923b-9563a0f3c853', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b2b0fe0-54aa-4d87-9d21-7525b0ddb9fc', 'enforce_multipath': True} {{(pid=82594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 11:26:04 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-ecf93048-ac45-4527-9ba7-275a05a99a8a req-b92c4a57-0f84-40c1-ba97-a67a94a1d52d tempest-VolumesAssistedSnapshotsTest-1016534801 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:26:04 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-ecf93048-ac45-4527-9ba7-275a05a99a8a req-b92c4a57-0f84-40c1-ba97-a67a94a1d52d tempest-VolumesAssistedSnapshotsTest-1016534801 None] attachment_update completed successfully.
Sep 10 11:26:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-f96d7dc6-0080-43c6-b24d-6856ec7abce6 req-121facfb-c3e7-4fc4-afa5-e509baeb3b29 tempest-TaggedAttachmentsTest-1630959102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:26:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-f96d7dc6-0080-43c6-b24d-6856ec7abce6 req-121facfb-c3e7-4fc4-afa5-e509baeb3b29 tempest-TaggedAttachmentsTest-1630959102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:26:08 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f403c533-d602-48b1-8528-ff91e206190f]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:26:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-f96d7dc6-0080-43c6-b24d-6856ec7abce6 req-121facfb-c3e7-4fc4-afa5-e509baeb3b29 tempest-TaggedAttachmentsTest-1630959102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-67e84527-8af3-44d2-891b-abce03b4b777 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:26:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-f96d7dc6-0080-43c6-b24d-6856ec7abce6 req-121facfb-c3e7-4fc4-afa5-e509baeb3b29 tempest-TaggedAttachmentsTest-1630959102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-67e84527-8af3-44d2-891b-abce03b4b777" returned: 0 in 1.090s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:26:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-f96d7dc6-0080-43c6-b24d-6856ec7abce6 req-121facfb-c3e7-4fc4-afa5-e509baeb3b29 tempest-TaggedAttachmentsTest-1630959102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.226s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:26:10 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-f96d7dc6-0080-43c6-b24d-6856ec7abce6 req-121facfb-c3e7-4fc4-afa5-e509baeb3b29 tempest-TaggedAttachmentsTest-1630959102 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56', 'name': 'volume-67e84527-8af3-44d2-891b-abce03b4b777', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1315bf18-3849-408c-9fc6-a7ed44fb3bbb', 'enforce_multipath': True} {{(pid=82594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 11:26:10 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-f96d7dc6-0080-43c6-b24d-6856ec7abce6 req-121facfb-c3e7-4fc4-afa5-e509baeb3b29 tempest-TaggedAttachmentsTest-1630959102 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:26:10 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-f96d7dc6-0080-43c6-b24d-6856ec7abce6 req-121facfb-c3e7-4fc4-afa5-e509baeb3b29 tempest-TaggedAttachmentsTest-1630959102 None] attachment_update completed successfully.
Sep 10 11:26:20 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:26:20 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:26:21 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:26:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:26:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:26:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:26:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:26:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:26:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:26:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.138s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:26:21 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:26:27 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:26:27 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:26:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Flow 'volume_create_manager' (e74a472a-9342-4715-acd7-46e6d6d559b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:26:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdfc413e-4a0c-41ab-b359-3c7151010a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:26:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdfc413e-4a0c-41ab-b359-3c7151010a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1240525563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192d2270-47a9-448f-b58a-a30602aac4a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69ede7c58b344e78b396afbba35baaad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:26:27Z,use_quota=True,user_id='40ee983e1cee46c99faae844d7bb420b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:26:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e91518-45c6-47cd-9191-0cde0d66f9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:26:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e91518-45c6-47cd-9191-0cde0d66f9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:26:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133e865e-7fbb-47e6-b2d7-b240352b0704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:26:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133e865e-7fbb-47e6-b2d7-b240352b0704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '192d2270-47a9-448f-b58a-a30602aac4a1', 'volume_name': 'volume-192d2270-47a9-448f-b58a-a30602aac4a1', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:26:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (385e7ebc-ada9-4894-8c7c-79adca187ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:26:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (385e7ebc-ada9-4894-8c7c-79adca187ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:26:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb0235c-990d-4784-912e-9cbe7d8b89d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:26:27 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Volume 192d2270-47a9-448f-b58a-a30602aac4a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-192d2270-47a9-448f-b58a-a30602aac4a1', 'volume_size': 1}
Sep 10 11:26:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:26:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:26:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1240525563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192d2270-47a9-448f-b58a-a30602aac4a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69ede7c58b344e78b396afbba35baaad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:26:27Z,use_quota=True,user_id='40ee983e1cee46c99faae844d7bb420b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:26:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Creating volume 192d2270-47a9-448f-b58a-a30602aac4a1 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:26:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:26:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:26:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:26:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:26:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:26:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:26:27 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:26:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-192d2270-47a9-448f-b58a-a30602aac4a1 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:26:27 devstack quobyte-client[82616]: System call of process 84782 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:26:27 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=5, name=volume-192d2270-47a9-448f-b58a-a30602aac4a1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:26:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-192d2270-47a9-448f-b58a-a30602aac4a1 1073741824" returned: 0 in 0.400s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:26:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-192d2270-47a9-448f-b58a-a30602aac4a1 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:26:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-192d2270-47a9-448f-b58a-a30602aac4a1" returned: 0 in 0.094s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:26:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] <== create_volume: return (588ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:26:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.605s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:26:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb0235c-990d-4784-912e-9cbe7d8b89d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-192d2270-47a9-448f-b58a-a30602aac4a1', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:26:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99394792-1b9b-4f4d-870d-17d144d9788d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:26:28 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Volume volume-192d2270-47a9-448f-b58a-a30602aac4a1 (192d2270-47a9-448f-b58a-a30602aac4a1): created successfully
Sep 10 11:26:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99394792-1b9b-4f4d-870d-17d144d9788d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:26:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Flow 'volume_create_manager' (e74a472a-9342-4715-acd7-46e6d6d559b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:26:28 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-cd176987-9ca9-4f9c-8192-6129c5855ae5 tempest-DeleteServersTestJSON-1684962694 None] Created volume successfully.
Sep 10 11:26:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-93144c5c-f6d0-4a38-bbe3-4ba204b174fa req-eb818c3c-35cb-4fa5-b3ce-3b9924f4a6d0 tempest-DeleteServersTestJSON-1684962694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:26:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-93144c5c-f6d0-4a38-bbe3-4ba204b174fa req-eb818c3c-35cb-4fa5-b3ce-3b9924f4a6d0 tempest-DeleteServersTestJSON-1684962694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:26:33 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a528abcf-a759-4443-8e73-bd2cd0b74b54]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:26:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-93144c5c-f6d0-4a38-bbe3-4ba204b174fa req-eb818c3c-35cb-4fa5-b3ce-3b9924f4a6d0 tempest-DeleteServersTestJSON-1684962694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-192d2270-47a9-448f-b58a-a30602aac4a1 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:26:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-93144c5c-f6d0-4a38-bbe3-4ba204b174fa req-eb818c3c-35cb-4fa5-b3ce-3b9924f4a6d0 tempest-DeleteServersTestJSON-1684962694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-192d2270-47a9-448f-b58a-a30602aac4a1" returned: 0 in 0.438s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:26:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-93144c5c-f6d0-4a38-bbe3-4ba204b174fa req-eb818c3c-35cb-4fa5-b3ce-3b9924f4a6d0 tempest-DeleteServersTestJSON-1684962694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.496s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:26:34 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-93144c5c-f6d0-4a38-bbe3-4ba204b174fa req-eb818c3c-35cb-4fa5-b3ce-3b9924f4a6d0 tempest-DeleteServersTestJSON-1684962694 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56', 'name': 'volume-192d2270-47a9-448f-b58a-a30602aac4a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b800111d-ddb5-442b-8a3d-7d4f60601832', 'enforce_multipath': True} {{(pid=82594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 11:26:34 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-93144c5c-f6d0-4a38-bbe3-4ba204b174fa req-eb818c3c-35cb-4fa5-b3ce-3b9924f4a6d0 tempest-DeleteServersTestJSON-1684962694 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:26:34 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-93144c5c-f6d0-4a38-bbe3-4ba204b174fa req-eb818c3c-35cb-4fa5-b3ce-3b9924f4a6d0 tempest-DeleteServersTestJSON-1684962694 None] attachment_update completed successfully.
Sep 10 11:26:36 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-26bfeac0-40e1-4903-82cd-ddfa05ef4e29 req-cd153cf5-e374-4aa2-be0a-c253fe0fef90 tempest-VolumesAssistedSnapshotsTest-1016534801 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:26:36 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-26bfeac0-40e1-4903-82cd-ddfa05ef4e29 req-cd153cf5-e374-4aa2-be0a-c253fe0fef90 tempest-VolumesAssistedSnapshotsTest-1016534801 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:26:36 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-26bfeac0-40e1-4903-82cd-ddfa05ef4e29 req-cd153cf5-e374-4aa2-be0a-c253fe0fef90 tempest-VolumesAssistedSnapshotsTest-1016534801 None] Terminate volume connection completed successfully.
Sep 10 11:26:36 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-26bfeac0-40e1-4903-82cd-ddfa05ef4e29 req-cd153cf5-e374-4aa2-be0a-c253fe0fef90 tempest-VolumesAssistedSnapshotsTest-1016534801 None] Deleting attachment 7b2b0fe0-54aa-4d87-9d21-7525b0ddb9fc. {{(pid=82594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 11:26:39 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-21acecb1-a797-4716-af94-260ffcd3f8b1 tempest-VolumesAssistedSnapshotsTest-1016534801 None] Acquiring lock "cinder-bb3cf2da-2d7c-4b79-923b-9563a0f3c853-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:26:39 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-21acecb1-a797-4716-af94-260ffcd3f8b1 tempest-VolumesAssistedSnapshotsTest-1016534801 None] Lock "cinder-bb3cf2da-2d7c-4b79-923b-9563a0f3c853-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:26:39 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-21acecb1-a797-4716-af94-260ffcd3f8b1 tempest-VolumesAssistedSnapshotsTest-1016534801 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:26:39 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-21acecb1-a797-4716-af94-260ffcd3f8b1 tempest-VolumesAssistedSnapshotsTest-1016534801 None] Acquiring lock "cinder-quobyte-bb3cf2da-2d7c-4b79-923b-9563a0f3c853" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:26:39 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-21acecb1-a797-4716-af94-260ffcd3f8b1 tempest-VolumesAssistedSnapshotsTest-1016534801 None] Lock "cinder-quobyte-bb3cf2da-2d7c-4b79-923b-9563a0f3c853" acquired by "delete_volume" :: waited 0.039s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:26:39 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6e49ab-dfb1-46ef-b844-cd92b285d871]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:26:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-21acecb1-a797-4716-af94-260ffcd3f8b1 tempest-VolumesAssistedSnapshotsTest-1016534801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bb3cf2da-2d7c-4b79-923b-9563a0f3c853 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:26:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-21acecb1-a797-4716-af94-260ffcd3f8b1 tempest-VolumesAssistedSnapshotsTest-1016534801 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bb3cf2da-2d7c-4b79-923b-9563a0f3c853" returned: 0 in 0.606s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:26:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-21acecb1-a797-4716-af94-260ffcd3f8b1 tempest-VolumesAssistedSnapshotsTest-1016534801 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bb3cf2da-2d7c-4b79-923b-9563a0f3c853 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:26:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-21acecb1-a797-4716-af94-260ffcd3f8b1 tempest-VolumesAssistedSnapshotsTest-1016534801 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bb3cf2da-2d7c-4b79-923b-9563a0f3c853" returned: 0 in 0.198s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:26:40 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-21acecb1-a797-4716-af94-260ffcd3f8b1 tempest-VolumesAssistedSnapshotsTest-1016534801 None] Lock "cinder-quobyte-bb3cf2da-2d7c-4b79-923b-9563a0f3c853" released by "delete_volume" :: held 0.997s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:26:40 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-21acecb1-a797-4716-af94-260ffcd3f8b1 tempest-VolumesAssistedSnapshotsTest-1016534801 None] Created reservations ['702af7ec-a82a-4491-abc3-a3dbb4f405d1', 'e7eb7592-9b5d-4443-8a8e-b5cbfc9190d1', 'e2894c9f-d245-49b0-99a7-8f7e49a5008e', 'bfe6e28e-d9e0-46c1-8139-7867d4a5d60b'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:26:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-21acecb1-a797-4716-af94-260ffcd3f8b1 tempest-VolumesAssistedSnapshotsTest-1016534801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:26:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-21acecb1-a797-4716-af94-260ffcd3f8b1 tempest-VolumesAssistedSnapshotsTest-1016534801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:26:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-21acecb1-a797-4716-af94-260ffcd3f8b1 tempest-VolumesAssistedSnapshotsTest-1016534801 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:26:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-21acecb1-a797-4716-af94-260ffcd3f8b1 tempest-VolumesAssistedSnapshotsTest-1016534801 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:26:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-21acecb1-a797-4716-af94-260ffcd3f8b1 tempest-VolumesAssistedSnapshotsTest-1016534801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:26:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-21acecb1-a797-4716-af94-260ffcd3f8b1 tempest-VolumesAssistedSnapshotsTest-1016534801 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:26:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-21acecb1-a797-4716-af94-260ffcd3f8b1 tempest-VolumesAssistedSnapshotsTest-1016534801 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.218s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:26:41 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-21acecb1-a797-4716-af94-260ffcd3f8b1 tempest-VolumesAssistedSnapshotsTest-1016534801 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:26:41 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-3318834d-66da-46ec-9d53-44c97770b293 req-cd100e51-2bd9-4840-ac20-5173c9934d31 tempest-TaggedAttachmentsTest-1630959102 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:26:41 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-21acecb1-a797-4716-af94-260ffcd3f8b1 tempest-VolumesAssistedSnapshotsTest-1016534801 None] Deleted volume successfully.
Sep 10 11:26:41 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-3318834d-66da-46ec-9d53-44c97770b293 req-cd100e51-2bd9-4840-ac20-5173c9934d31 tempest-TaggedAttachmentsTest-1630959102 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:26:41 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-3318834d-66da-46ec-9d53-44c97770b293 req-cd100e51-2bd9-4840-ac20-5173c9934d31 tempest-TaggedAttachmentsTest-1630959102 None] Terminate volume connection completed successfully.
Sep 10 11:26:41 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-3318834d-66da-46ec-9d53-44c97770b293 req-cd100e51-2bd9-4840-ac20-5173c9934d31 tempest-TaggedAttachmentsTest-1630959102 None] Deleting attachment 1315bf18-3849-408c-9fc6-a7ed44fb3bbb. {{(pid=82594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 11:26:41 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-21acecb1-a797-4716-af94-260ffcd3f8b1 tempest-VolumesAssistedSnapshotsTest-1016534801 None] Lock "cinder-bb3cf2da-2d7c-4b79-923b-9563a0f3c853-delete_volume" released by "delete_volume" :: held 2.740s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:26:47 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-fe3d68a5-17f6-4294-baa2-75bc7bee37ad req-69723af9-2403-48f8-8088-7dabc18b6ad7 tempest-DeleteServersTestJSON-1684962694 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:26:47 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-fe3d68a5-17f6-4294-baa2-75bc7bee37ad req-69723af9-2403-48f8-8088-7dabc18b6ad7 tempest-DeleteServersTestJSON-1684962694 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:26:47 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-fe3d68a5-17f6-4294-baa2-75bc7bee37ad req-69723af9-2403-48f8-8088-7dabc18b6ad7 tempest-DeleteServersTestJSON-1684962694 None] Terminate volume connection completed successfully.
Sep 10 11:26:47 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-fe3d68a5-17f6-4294-baa2-75bc7bee37ad req-69723af9-2403-48f8-8088-7dabc18b6ad7 tempest-DeleteServersTestJSON-1684962694 None] Deleting attachment b800111d-ddb5-442b-8a3d-7d4f60601832. {{(pid=82594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 11:26:51 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=15,cinder:DELETE=2,cinder:SELECT=9 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:26:52 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-392769d8-4e5a-4d33-b2a8-21de820d497d tempest-DeleteServersTestJSON-1684962694 None] Acquiring lock "cinder-192d2270-47a9-448f-b58a-a30602aac4a1-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:26:52 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-392769d8-4e5a-4d33-b2a8-21de820d497d tempest-DeleteServersTestJSON-1684962694 None] Lock "cinder-192d2270-47a9-448f-b58a-a30602aac4a1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:26:53 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-392769d8-4e5a-4d33-b2a8-21de820d497d tempest-DeleteServersTestJSON-1684962694 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:26:53 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-392769d8-4e5a-4d33-b2a8-21de820d497d tempest-DeleteServersTestJSON-1684962694 None] Acquiring lock "cinder-quobyte-192d2270-47a9-448f-b58a-a30602aac4a1" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:26:53 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-392769d8-4e5a-4d33-b2a8-21de820d497d tempest-DeleteServersTestJSON-1684962694 None] Lock "cinder-quobyte-192d2270-47a9-448f-b58a-a30602aac4a1" acquired by "delete_volume" :: waited 0.013s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:26:53 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f769c62-5203-4426-a538-1d00b469b415]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:26:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-392769d8-4e5a-4d33-b2a8-21de820d497d tempest-DeleteServersTestJSON-1684962694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-192d2270-47a9-448f-b58a-a30602aac4a1 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:26:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-392769d8-4e5a-4d33-b2a8-21de820d497d tempest-DeleteServersTestJSON-1684962694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-192d2270-47a9-448f-b58a-a30602aac4a1" returned: 0 in 0.415s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:26:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-392769d8-4e5a-4d33-b2a8-21de820d497d tempest-DeleteServersTestJSON-1684962694 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-192d2270-47a9-448f-b58a-a30602aac4a1 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:26:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-392769d8-4e5a-4d33-b2a8-21de820d497d tempest-DeleteServersTestJSON-1684962694 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-192d2270-47a9-448f-b58a-a30602aac4a1" returned: 0 in 0.098s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:26:53 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-392769d8-4e5a-4d33-b2a8-21de820d497d tempest-DeleteServersTestJSON-1684962694 None] Lock "cinder-quobyte-192d2270-47a9-448f-b58a-a30602aac4a1" released by "delete_volume" :: held 0.624s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:26:53 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-392769d8-4e5a-4d33-b2a8-21de820d497d tempest-DeleteServersTestJSON-1684962694 None] Created reservations ['313f06fd-6d57-435c-af28-3888679bcbec', '46978aa4-aaae-4991-9861-4b8162e2b46a', '89c6d0d7-3de2-4bd8-9f5d-811d25ea88f3', '18fb94d5-00d4-40bd-8f64-19f6b5162cac'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:26:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-392769d8-4e5a-4d33-b2a8-21de820d497d tempest-DeleteServersTestJSON-1684962694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:26:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-392769d8-4e5a-4d33-b2a8-21de820d497d tempest-DeleteServersTestJSON-1684962694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:26:54 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-392769d8-4e5a-4d33-b2a8-21de820d497d tempest-DeleteServersTestJSON-1684962694 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:26:54 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-392769d8-4e5a-4d33-b2a8-21de820d497d tempest-DeleteServersTestJSON-1684962694 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:26:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-392769d8-4e5a-4d33-b2a8-21de820d497d tempest-DeleteServersTestJSON-1684962694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:26:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-392769d8-4e5a-4d33-b2a8-21de820d497d tempest-DeleteServersTestJSON-1684962694 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:26:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-392769d8-4e5a-4d33-b2a8-21de820d497d tempest-DeleteServersTestJSON-1684962694 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.206s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:26:54 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-392769d8-4e5a-4d33-b2a8-21de820d497d tempest-DeleteServersTestJSON-1684962694 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:26:54 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-392769d8-4e5a-4d33-b2a8-21de820d497d tempest-DeleteServersTestJSON-1684962694 None] Deleted volume successfully.
Sep 10 11:26:54 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-392769d8-4e5a-4d33-b2a8-21de820d497d tempest-DeleteServersTestJSON-1684962694 None] Lock "cinder-192d2270-47a9-448f-b58a-a30602aac4a1-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:27:04 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=27,cinder:UPDATE=18,cinder:INSERT=7 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:27:04 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:27:21 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:27:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:27:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:27:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:27:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:27:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.067s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:27:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:27:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.321s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:27:22 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:27:38 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-719b629d-7d41-4fd3-818a-ed5b52bd4548 tempest-TaggedAttachmentsTest-1630959102 None] Acquiring lock "cinder-67e84527-8af3-44d2-891b-abce03b4b777-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:27:39 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-719b629d-7d41-4fd3-818a-ed5b52bd4548 tempest-TaggedAttachmentsTest-1630959102 None] Lock "cinder-67e84527-8af3-44d2-891b-abce03b4b777-delete_volume" acquired by "delete_volume" :: waited 0.141s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:27:39 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:27:39 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:27:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Flow 'volume_create_manager' (97ed8fe8-860c-412a-a931-392d8d998b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:27:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9150af47-049b-40ab-953f-b0c67223e81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:27:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9150af47-049b-40ab-953f-b0c67223e81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1654568271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2bd417ccfaf464b9d3c882f6644387c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:27:39Z,use_quota=True,user_id='da21eac1e2784d978e0430832380e24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:27:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd4a575-13f5-4359-aae6-bd5562506298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:27:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd4a575-13f5-4359-aae6-bd5562506298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:27:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8fac28-3c5a-4d2f-ab17-601706b92b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:27:39 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-719b629d-7d41-4fd3-818a-ed5b52bd4548 tempest-TaggedAttachmentsTest-1630959102 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:27:39 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-719b629d-7d41-4fd3-818a-ed5b52bd4548 tempest-TaggedAttachmentsTest-1630959102 None] Acquiring lock "cinder-quobyte-67e84527-8af3-44d2-891b-abce03b4b777" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:27:39 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-719b629d-7d41-4fd3-818a-ed5b52bd4548 tempest-TaggedAttachmentsTest-1630959102 None] Lock "cinder-quobyte-67e84527-8af3-44d2-891b-abce03b4b777" acquired by "delete_volume" :: waited 0.027s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:27:39 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c8a4b5-49b0-498c-b174-6adcb897e55c]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:27:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-719b629d-7d41-4fd3-818a-ed5b52bd4548 tempest-TaggedAttachmentsTest-1630959102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-67e84527-8af3-44d2-891b-abce03b4b777 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:27:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8fac28-3c5a-4d2f-ab17-601706b92b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28', 'volume_name': 'volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28', 'volume_size': 1, 'image_id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee56e2a9864a4b70aa312dea5a262bbd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'created_at': datetime.datetime(2025, 9, 10, 9, 15, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 9, 15, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39a0ac1b-5093-4de2-911f-205906a7575b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4f51b9f5e0>}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:27:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41ea239-3309-49b4-9bf5-6f8fd078e62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:27:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41ea239-3309-49b4-9bf5-6f8fd078e62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:27:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3afd17b-0483-465c-927b-19d19a4bccd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:27:40 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Volume 1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28', 'volume_size': 1, 'image_id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee56e2a9864a4b70aa312dea5a262bbd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'created_at': datetime.datetime(2025, 9, 10, 9, 15, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 9, 15, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39a0ac1b-5093-4de2-911f-205906a7575b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4f51b9f5e0>}
Sep 10 11:27:40 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Cloning 1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28 from image 39a0ac1b-5093-4de2-911f-205906a7575b  at location (None, None). {{(pid=82594) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 11:27:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-719b629d-7d41-4fd3-818a-ed5b52bd4548 tempest-TaggedAttachmentsTest-1630959102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-67e84527-8af3-44d2-891b-abce03b4b777" returned: 0 in 0.777s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:27:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-719b629d-7d41-4fd3-818a-ed5b52bd4548 tempest-TaggedAttachmentsTest-1630959102 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-67e84527-8af3-44d2-891b-abce03b4b777 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:27:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-719b629d-7d41-4fd3-818a-ed5b52bd4548 tempest-TaggedAttachmentsTest-1630959102 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-67e84527-8af3-44d2-891b-abce03b4b777" returned: 0 in 0.226s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:27:40 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-719b629d-7d41-4fd3-818a-ed5b52bd4548 tempest-TaggedAttachmentsTest-1630959102 None] Lock "cinder-quobyte-67e84527-8af3-44d2-891b-abce03b4b777" released by "delete_volume" :: held 1.110s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:27:40 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-719b629d-7d41-4fd3-818a-ed5b52bd4548 tempest-TaggedAttachmentsTest-1630959102 None] Created reservations ['6e9d1a82-32ee-4acc-92ee-5119dc15dc49', 'c76bb3a3-c84e-4905-a045-d55a852b9c2c', '5960c9d8-a931-4696-8e24-3dc0f216e481', '11e94af2-c775-4bf7-b63b-5751b41b81d8'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:27:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-719b629d-7d41-4fd3-818a-ed5b52bd4548 tempest-TaggedAttachmentsTest-1630959102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:27:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-719b629d-7d41-4fd3-818a-ed5b52bd4548 tempest-TaggedAttachmentsTest-1630959102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:27:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-719b629d-7d41-4fd3-818a-ed5b52bd4548 tempest-TaggedAttachmentsTest-1630959102 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:27:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-719b629d-7d41-4fd3-818a-ed5b52bd4548 tempest-TaggedAttachmentsTest-1630959102 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:27:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-719b629d-7d41-4fd3-818a-ed5b52bd4548 tempest-TaggedAttachmentsTest-1630959102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:27:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-719b629d-7d41-4fd3-818a-ed5b52bd4548 tempest-TaggedAttachmentsTest-1630959102 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:27:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-719b629d-7d41-4fd3-818a-ed5b52bd4548 tempest-TaggedAttachmentsTest-1630959102 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.211s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:27:41 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-719b629d-7d41-4fd3-818a-ed5b52bd4548 tempest-TaggedAttachmentsTest-1630959102 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:27:41 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-719b629d-7d41-4fd3-818a-ed5b52bd4548 tempest-TaggedAttachmentsTest-1630959102 None] Deleted volume successfully.
Sep 10 11:27:41 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_57h8oanqdevstack@QuobyteHD, size 20.69 MB, duration 1.70 sec {{(pid=82594) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 11:27:41 devstack cinder-volume[82594]: INFO cinder.image.image_utils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Image download 20.69 MB at 12.17 MB/s
Sep 10 11:27:41 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-719b629d-7d41-4fd3-818a-ed5b52bd4548 tempest-TaggedAttachmentsTest-1630959102 None] Lock "cinder-67e84527-8af3-44d2-891b-abce03b4b777-delete_volume" released by "delete_volume" :: held 2.936s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:27:42 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cc0a38-b4f5-4d09-b1cb-76fe97e54682]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:27:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_57h8oanqdevstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:27:42 devstack sudo[85080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_57h8oanqdevstack@QuobyteHD
Sep 10 11:27:42 devstack sudo[85080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:27:44 devstack sudo[85080]: pam_unix(sudo:session): session closed for user root
Sep 10 11:27:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_57h8oanqdevstack@QuobyteHD" returned: 0 in 2.785s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:27:44 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Temporary image 39a0ac1b-5093-4de2-911f-205906a7575b is fetched for user da21eac1e2784d978e0430832380e24f. {{(pid=82594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 11:27:45 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b196b2e8-24a1-4a84-a277-32b09d3e1928]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:27:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_57h8oanqdevstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:27:45 devstack sudo[85085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_57h8oanqdevstack@QuobyteHD
Sep 10 11:27:45 devstack sudo[85085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:27:48 devstack sudo[85085]: pam_unix(sudo:session): session closed for user root
Sep 10 11:27:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_57h8oanqdevstack@QuobyteHD" returned: 0 in 3.527s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:27:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:27:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.020s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:27:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1654568271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2bd417ccfaf464b9d3c882f6644387c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:27:39Z,use_quota=True,user_id='da21eac1e2784d978e0430832380e24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:27:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Creating volume 1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:27:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:27:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:27:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:27:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:27:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:27:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:27:49 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:27:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:27:49 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=6, name=volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:27:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28 1073741824" returned: 0 in 0.475s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:27:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:27:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28" returned: 0 in 0.225s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:27:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] <== create_volume: return (805ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:27:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:27:50 devstack cinder-volume[82594]: DEBUG cinder.volume.volume_utils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Attempting download of 39a0ac1b-5093-4de2-911f-205906a7575b ((None, None)) to volume 1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28. {{(pid=82594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 11:27:50 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[01723f04-7a8f-4526-b99e-f76610d5c4be]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:27:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_39a0ac1b-5093-4de2-911f-205906a7575b_azb7jwqp {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:27:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_39a0ac1b-5093-4de2-911f-205906a7575b_azb7jwqp" returned: 0 in 0.568s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:27:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39a0ac1b-5093-4de2-911f-205906a7575b_azb7jwqp {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:27:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39a0ac1b-5093-4de2-911f-205906a7575b_azb7jwqp" returned: 1 in 0.493s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:27:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39a0ac1b-5093-4de2-911f-205906a7575b_azb7jwqp' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 11:27:51 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[891dc3c0-28de-44fd-beba-dedefa0141c4]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:27:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_57h8oanqdevstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:27:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_57h8oanqdevstack@QuobyteHD" returned: 0 in 0.541s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:27:52 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] 39a0ac1b-5093-4de2-911f-205906a7575b was qcow2, converting to raw {{(pid=82594) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 11:27:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_57h8oanqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:27:52 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=6, name=volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:27:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_57h8oanqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28" returned: 0 in 1.443s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:27:53 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_57h8oanqdevstack@QuobyteHD, size 112.00 MB, duration 1.47 sec, destination /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28 {{(pid=82594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 11:27:53 devstack cinder-volume[82594]: INFO cinder.image.image_utils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Converted 112.00 MB image at 76.21 MB/s
Sep 10 11:27:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:27:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28 1G" returned: 0 in 0.264s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:27:54 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8cb5e6-bc91-4752-a7e4-8a2ed4ed7f9d]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:27:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:27:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28" returned: 0 in 0.466s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:27:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:27:55 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=7,cinder:SELECT=8,cinder:INSERT=5,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:27:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28" returned: 1 in 0.749s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:27:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 11:27:55 devstack cinder-volume[82594]: DEBUG cinder.volume.volume_utils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Downloaded image 39a0ac1b-5093-4de2-911f-205906a7575b ((None, None)) to volume 1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28 successfully. {{(pid=82594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 11:27:55 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Temporary image 39a0ac1b-5093-4de2-911f-205906a7575b for user da21eac1e2784d978e0430832380e24f is deleted. {{(pid=82594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 11:27:55 devstack cinder-volume[82594]: DEBUG cinder.volume.volume_utils [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Marking volume 1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28 as bootable. {{(pid=82594) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 11:27:55 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Copying metadata from image 39a0ac1b-5093-4de2-911f-205906a7575b to 1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28. {{(pid=82594) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 11:27:55 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Creating volume glance metadata for volume 1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28 backed by image 39a0ac1b-5093-4de2-911f-205906a7575b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82594) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 11:27:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3afd17b-0483-465c-927b-19d19a4bccd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28', 'volume_size': 1, 'image_id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee56e2a9864a4b70aa312dea5a262bbd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'created_at': datetime.datetime(2025, 9, 10, 9, 15, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 9, 15, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39a0ac1b-5093-4de2-911f-205906a7575b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4f51b9f5e0>}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:27:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7995d82a-2c75-4dcd-b47f-3443b6226f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:27:56 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Volume volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28 (1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28): created successfully
Sep 10 11:27:56 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7995d82a-2c75-4dcd-b47f-3443b6226f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:27:56 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Flow 'volume_create_manager' (97ed8fe8-860c-412a-a931-392d8d998b87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:27:56 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-699fbe3e-1503-469a-ad0a-1c9bc74f9983 tempest-TaggedBootDevicesTest-820793285 None] Created volume successfully.
Sep 10 11:27:57 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:27:57 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:27:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Flow 'volume_create_manager' (64cc7ed6-0a38-4616-9e05-331b5a6655aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:27:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eabd0f82-230f-4d64-a9b0-476129856d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:27:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eabd0f82-230f-4d64-a9b0-476129856d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-221839937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2365fdcc-1e80-4c3b-8538-eb8b97bc2449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2bd417ccfaf464b9d3c882f6644387c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:27:57Z,use_quota=True,user_id='da21eac1e2784d978e0430832380e24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:27:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (361b1992-62d8-49a1-901e-ca99c212fd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:27:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (361b1992-62d8-49a1-901e-ca99c212fd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:27:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0dd12ae-41f8-4835-a5f0-6c3c0901f306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:27:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0dd12ae-41f8-4835-a5f0-6c3c0901f306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2365fdcc-1e80-4c3b-8538-eb8b97bc2449', 'volume_name': 'volume-2365fdcc-1e80-4c3b-8538-eb8b97bc2449', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:27:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b5bbe0b-2947-42df-b846-1d16f731888f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:27:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b5bbe0b-2947-42df-b846-1d16f731888f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:27:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52aad0f9-c342-4b82-ac1c-bb61d6f43847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:27:57 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Volume 2365fdcc-1e80-4c3b-8538-eb8b97bc2449: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2365fdcc-1e80-4c3b-8538-eb8b97bc2449', 'volume_size': 1}
Sep 10 11:27:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:27:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:27:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-221839937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2365fdcc-1e80-4c3b-8538-eb8b97bc2449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2bd417ccfaf464b9d3c882f6644387c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:27:57Z,use_quota=True,user_id='da21eac1e2784d978e0430832380e24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:27:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Creating volume 2365fdcc-1e80-4c3b-8538-eb8b97bc2449 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:27:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:27:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:27:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:27:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:27:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:27:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:27:57 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:27:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2365fdcc-1e80-4c3b-8538-eb8b97bc2449 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:27:58 devstack quobyte-client[82616]: System call of process 85124 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:27:58 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=7, name=volume-2365fdcc-1e80-4c3b-8538-eb8b97bc2449, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:27:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2365fdcc-1e80-4c3b-8538-eb8b97bc2449 1073741824" returned: 0 in 0.622s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:27:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2365fdcc-1e80-4c3b-8538-eb8b97bc2449 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:27:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2365fdcc-1e80-4c3b-8538-eb8b97bc2449" returned: 0 in 0.189s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:27:58 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] <== create_volume: return (993ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:27:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:27:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52aad0f9-c342-4b82-ac1c-bb61d6f43847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2365fdcc-1e80-4c3b-8538-eb8b97bc2449', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:27:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61ab388-5214-4674-8c37-49d10e4c78b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:27:59 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Volume volume-2365fdcc-1e80-4c3b-8538-eb8b97bc2449 (2365fdcc-1e80-4c3b-8538-eb8b97bc2449): created successfully
Sep 10 11:27:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61ab388-5214-4674-8c37-49d10e4c78b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:27:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Flow 'volume_create_manager' (64cc7ed6-0a38-4616-9e05-331b5a6655aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:27:59 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-62c03136-b506-4a7e-ac8c-67fe309c4746 tempest-TaggedBootDevicesTest-820793285 None] Created volume successfully.
Sep 10 11:28:00 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:28:00 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:28:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Flow 'volume_create_manager' (afc3e0a8-72b0-46cd-82dc-bd03652ed84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:28:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe52b46f-b1d4-4ae0-8636-706d33a0bbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:28:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe52b46f-b1d4-4ae0-8636-706d33a0bbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-713258626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1105e0bd-dbe3-45d1-b2bd-7864d0612ed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2bd417ccfaf464b9d3c882f6644387c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:28:00Z,use_quota=True,user_id='da21eac1e2784d978e0430832380e24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:28:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc31ee2-ae03-496e-9516-5af4bc512560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:28:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc31ee2-ae03-496e-9516-5af4bc512560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:28:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df656320-587a-49f2-8f84-56971778d4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:28:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df656320-587a-49f2-8f84-56971778d4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1105e0bd-dbe3-45d1-b2bd-7864d0612ed4', 'volume_name': 'volume-1105e0bd-dbe3-45d1-b2bd-7864d0612ed4', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:28:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eabe351-551c-42d5-a102-3947a5b416c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:28:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eabe351-551c-42d5-a102-3947a5b416c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:28:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94986ad-1897-4478-96fc-a4ec73a69d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:28:00 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Volume 1105e0bd-dbe3-45d1-b2bd-7864d0612ed4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1105e0bd-dbe3-45d1-b2bd-7864d0612ed4', 'volume_size': 1}
Sep 10 11:28:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:28:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:28:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-713258626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1105e0bd-dbe3-45d1-b2bd-7864d0612ed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2bd417ccfaf464b9d3c882f6644387c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:28:00Z,use_quota=True,user_id='da21eac1e2784d978e0430832380e24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:28:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Creating volume 1105e0bd-dbe3-45d1-b2bd-7864d0612ed4 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:28:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:28:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:28:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:28:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:28:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:28:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:28:00 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:28:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1105e0bd-dbe3-45d1-b2bd-7864d0612ed4 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:28:00 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=8, name=volume-1105e0bd-dbe3-45d1-b2bd-7864d0612ed4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:28:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1105e0bd-dbe3-45d1-b2bd-7864d0612ed4 1073741824" returned: 0 in 0.499s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:28:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1105e0bd-dbe3-45d1-b2bd-7864d0612ed4 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:28:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1105e0bd-dbe3-45d1-b2bd-7864d0612ed4" returned: 0 in 0.203s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:28:01 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] <== create_volume: return (785ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:28:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:28:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94986ad-1897-4478-96fc-a4ec73a69d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1105e0bd-dbe3-45d1-b2bd-7864d0612ed4', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:28:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e1bfe6-ba9a-4075-a822-0c1b8bb20689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:28:01 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Volume volume-1105e0bd-dbe3-45d1-b2bd-7864d0612ed4 (1105e0bd-dbe3-45d1-b2bd-7864d0612ed4): created successfully
Sep 10 11:28:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e1bfe6-ba9a-4075-a822-0c1b8bb20689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:28:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Flow 'volume_create_manager' (afc3e0a8-72b0-46cd-82dc-bd03652ed84f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:28:01 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-e6b055eb-c2ae-45c2-8c17-4f613d35fe3c tempest-TaggedBootDevicesTest-820793285 None] Created volume successfully.
Sep 10 11:28:11 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=20,cinder:UPDATE=20,cinder:INSERT=12,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:28:15 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=5,cinder:DELETE=2,cinder:SELECT=4 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:28:21 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:28:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:28:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:28:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:28:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:28:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:28:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:28:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.143s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:28:21 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:28:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-7d1fe127-9c25-4d63-a9ac-a5c6e3d80e05 tempest-TaggedBootDevicesTest-820793285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:28:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-7d1fe127-9c25-4d63-a9ac-a5c6e3d80e05 tempest-TaggedBootDevicesTest-820793285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.013s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:28:42 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[52224b86-559f-4726-9947-85f266b93508]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:28:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-7d1fe127-9c25-4d63-a9ac-a5c6e3d80e05 tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:28:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-7d1fe127-9c25-4d63-a9ac-a5c6e3d80e05 tempest-TaggedBootDevicesTest-820793285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28" returned: 0 in 1.048s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:28:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-7d1fe127-9c25-4d63-a9ac-a5c6e3d80e05 tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:28:44 devstack quobyte-client[82616]: System call of process 85252 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:28:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-7d1fe127-9c25-4d63-a9ac-a5c6e3d80e05 tempest-TaggedBootDevicesTest-820793285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28" returned: 1 in 1.233s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:28:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-7d1fe127-9c25-4d63-a9ac-a5c6e3d80e05 tempest-TaggedBootDevicesTest-820793285 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 11:28:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-7d1fe127-9c25-4d63-a9ac-a5c6e3d80e05 tempest-TaggedBootDevicesTest-820793285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.549s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:28:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-7d1fe127-9c25-4d63-a9ac-a5c6e3d80e05 tempest-TaggedBootDevicesTest-820793285 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56', 'name': 'volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23143ff2-2ea4-4e39-b529-2dce56b06d6b', 'enforce_multipath': True} {{(pid=82594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 11:28:45 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-7d1fe127-9c25-4d63-a9ac-a5c6e3d80e05 tempest-TaggedBootDevicesTest-820793285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:28:45 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-7d1fe127-9c25-4d63-a9ac-a5c6e3d80e05 tempest-TaggedBootDevicesTest-820793285 None] attachment_update completed successfully.
Sep 10 11:28:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-19d3af57-994b-4b2a-a6d0-f1d8ac27a395 tempest-TaggedBootDevicesTest-820793285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:28:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-19d3af57-994b-4b2a-a6d0-f1d8ac27a395 tempest-TaggedBootDevicesTest-820793285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.032s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:28:50 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd558e7-1106-440c-b293-3bdc3ba30205]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:28:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-19d3af57-994b-4b2a-a6d0-f1d8ac27a395 tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2365fdcc-1e80-4c3b-8538-eb8b97bc2449 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:28:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-19d3af57-994b-4b2a-a6d0-f1d8ac27a395 tempest-TaggedBootDevicesTest-820793285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2365fdcc-1e80-4c3b-8538-eb8b97bc2449" returned: 0 in 2.242s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:28:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-19d3af57-994b-4b2a-a6d0-f1d8ac27a395 tempest-TaggedBootDevicesTest-820793285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.581s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:28:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-19d3af57-994b-4b2a-a6d0-f1d8ac27a395 tempest-TaggedBootDevicesTest-820793285 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56', 'name': 'volume-2365fdcc-1e80-4c3b-8538-eb8b97bc2449', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b0400f3-66e9-40f6-8578-85e4846aa68d', 'enforce_multipath': True} {{(pid=82594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 11:28:54 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-19d3af57-994b-4b2a-a6d0-f1d8ac27a395 tempest-TaggedBootDevicesTest-820793285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:28:56 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-19d3af57-994b-4b2a-a6d0-f1d8ac27a395 tempest-TaggedBootDevicesTest-820793285 None] attachment_update completed successfully.
Sep 10 11:29:06 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=14,cinder:UPDATE=2 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:29:06 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:29:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-87a84e8e-b0cf-4aad-a9a0-62efb8b0d7e1 tempest-TaggedBootDevicesTest-820793285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:29:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-87a84e8e-b0cf-4aad-a9a0-62efb8b0d7e1 tempest-TaggedBootDevicesTest-820793285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:29:09 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf5636c-11c0-46e0-b567-a8b8f5f6bc5a]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:29:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-87a84e8e-b0cf-4aad-a9a0-62efb8b0d7e1 tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1105e0bd-dbe3-45d1-b2bd-7864d0612ed4 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:29:12 devstack quobyte-client[82616]: System call of process 85498 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:29:12 devstack quobyte-client[82616]: System call of process 85498 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:29:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-87a84e8e-b0cf-4aad-a9a0-62efb8b0d7e1 tempest-TaggedBootDevicesTest-820793285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1105e0bd-dbe3-45d1-b2bd-7864d0612ed4" returned: 0 in 2.198s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:29:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-87a84e8e-b0cf-4aad-a9a0-62efb8b0d7e1 tempest-TaggedBootDevicesTest-820793285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.451s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:29:12 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-87a84e8e-b0cf-4aad-a9a0-62efb8b0d7e1 tempest-TaggedBootDevicesTest-820793285 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56', 'name': 'volume-1105e0bd-dbe3-45d1-b2bd-7864d0612ed4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '87120501-204e-4e79-99da-d1f88f86d791', 'enforce_multipath': True} {{(pid=82594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 11:29:13 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-87a84e8e-b0cf-4aad-a9a0-62efb8b0d7e1 tempest-TaggedBootDevicesTest-820793285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:29:13 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-6694a26a-55ff-4811-bca6-0e0767d7e00b req-87a84e8e-b0cf-4aad-a9a0-62efb8b0d7e1 tempest-TaggedBootDevicesTest-820793285 None] attachment_update completed successfully.
Sep 10 11:29:21 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:29:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:29:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:29:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:29:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:29:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:29:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:29:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.554s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:29:22 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:29:23 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:29:23 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:30:15 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:30:15 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:30:21 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:30:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:30:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:30:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:30:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:30:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:30:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:30:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.245s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:30:22 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:30:26 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:30:26 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:30:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Flow 'volume_create_manager' (2865a083-c19c-4add-a3f3-563d797dc956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:30:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f0abb66-341a-4728-b611-66ba23f1432f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:30:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f0abb66-341a-4728-b611-66ba23f1432f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-859451023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8d08b8-0017-496b-90af-cbbe695f8396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9987f31f8dd1465788a0c09d25fd87b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:30:25Z,use_quota=True,user_id='8d853555090c49368e7a0247b82a3a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:30:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (197b05f6-262e-4de5-ac50-ffc2d44fac8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:30:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (197b05f6-262e-4de5-ac50-ffc2d44fac8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:30:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b78ea13-b26c-47d5-aa07-caec149d7aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:30:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b78ea13-b26c-47d5-aa07-caec149d7aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b8d08b8-0017-496b-90af-cbbe695f8396', 'volume_name': 'volume-6b8d08b8-0017-496b-90af-cbbe695f8396', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:30:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e0b2f01-266c-4a34-8292-c57139803caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:30:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e0b2f01-266c-4a34-8292-c57139803caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:30:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d8d2346-56b3-45f9-b525-9e04b7c023d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:30:27 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Volume 6b8d08b8-0017-496b-90af-cbbe695f8396: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b8d08b8-0017-496b-90af-cbbe695f8396', 'volume_size': 1}
Sep 10 11:30:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:30:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:30:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-859451023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8d08b8-0017-496b-90af-cbbe695f8396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9987f31f8dd1465788a0c09d25fd87b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:30:25Z,use_quota=True,user_id='8d853555090c49368e7a0247b82a3a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:30:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Creating volume 6b8d08b8-0017-496b-90af-cbbe695f8396 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:30:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:30:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:30:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:30:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:30:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:30:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:30:27 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:30:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6b8d08b8-0017-496b-90af-cbbe695f8396 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:30:27 devstack quobyte-client[82616]: System call of process 86525 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:30:27 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=9, name=volume-6b8d08b8-0017-496b-90af-cbbe695f8396, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:30:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6b8d08b8-0017-496b-90af-cbbe695f8396 1073741824" returned: 0 in 1.508s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:30:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6b8d08b8-0017-496b-90af-cbbe695f8396 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:30:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6b8d08b8-0017-496b-90af-cbbe695f8396" returned: 0 in 0.614s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:30:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] <== create_volume: return (2327ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:30:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.391s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:30:29 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:30:30 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:30:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Flow 'volume_create_manager' (66276e9f-4e07-47a6-bcf7-74c5e060d261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:30:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e954d02-c912-43fa-8a83-07356f69b786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:30:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d8d2346-56b3-45f9-b525-9e04b7c023d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b8d08b8-0017-496b-90af-cbbe695f8396', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:30:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da69a06b-2e81-466b-8fca-c352c3dab397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:30:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e954d02-c912-43fa-8a83-07356f69b786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1824234794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf5841d0-382c-4d1a-a2c8-51f1ae7556be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbe175942a4244bd8acb4826a6e47221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:30:27Z,use_quota=True,user_id='3224a2f4eb2c498783aef4f5e935622b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:30:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c1ca4c-ffe9-4384-bc17-a0459a12aad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:30:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c1ca4c-ffe9-4384-bc17-a0459a12aad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:30:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1521d9cb-5f2e-4774-af7e-cd6625a59157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:30:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1521d9cb-5f2e-4774-af7e-cd6625a59157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf5841d0-382c-4d1a-a2c8-51f1ae7556be', 'volume_name': 'volume-cf5841d0-382c-4d1a-a2c8-51f1ae7556be', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:30:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5dafc2-2371-40b1-bcd1-9a0129380a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:30:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5dafc2-2371-40b1-bcd1-9a0129380a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:30:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a12dfe-160b-457d-9bd1-3b950423f0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:30:30 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Volume cf5841d0-382c-4d1a-a2c8-51f1ae7556be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf5841d0-382c-4d1a-a2c8-51f1ae7556be', 'volume_size': 1}
Sep 10 11:30:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:30:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.026s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:30:30 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1824234794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf5841d0-382c-4d1a-a2c8-51f1ae7556be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbe175942a4244bd8acb4826a6e47221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:30:27Z,use_quota=True,user_id='3224a2f4eb2c498783aef4f5e935622b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:30:30 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Creating volume cf5841d0-382c-4d1a-a2c8-51f1ae7556be {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:30:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:30:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:30:30 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:30:30 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:30:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:30:30 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:30:30 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:30:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-cf5841d0-382c-4d1a-a2c8-51f1ae7556be 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:30:30 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=10, name=volume-cf5841d0-382c-4d1a-a2c8-51f1ae7556be, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:30:31 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Volume volume-6b8d08b8-0017-496b-90af-cbbe695f8396 (6b8d08b8-0017-496b-90af-cbbe695f8396): created successfully
Sep 10 11:30:31 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da69a06b-2e81-466b-8fca-c352c3dab397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:30:31 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Flow 'volume_create_manager' (2865a083-c19c-4add-a3f3-563d797dc956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:30:31 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-6190000c-20fa-4d2d-927f-96031a1230ea tempest-AttachVolumeTestJSON-901448073 None] Created volume successfully.
Sep 10 11:30:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-cf5841d0-382c-4d1a-a2c8-51f1ae7556be 1073741824" returned: 0 in 0.900s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:30:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-cf5841d0-382c-4d1a-a2c8-51f1ae7556be {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:30:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-cf5841d0-382c-4d1a-a2c8-51f1ae7556be" returned: 0 in 0.315s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:30:32 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] <== create_volume: return (1447ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:30:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:30:32 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a12dfe-160b-457d-9bd1-3b950423f0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf5841d0-382c-4d1a-a2c8-51f1ae7556be', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:30:32 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f343f6a2-4404-4f5e-8098-6580662e58f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:30:32 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Volume volume-cf5841d0-382c-4d1a-a2c8-51f1ae7556be (cf5841d0-382c-4d1a-a2c8-51f1ae7556be): created successfully
Sep 10 11:30:32 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f343f6a2-4404-4f5e-8098-6580662e58f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:30:32 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Flow 'volume_create_manager' (66276e9f-4e07-47a6-bcf7-74c5e060d261) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:30:32 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-1d49d8fb-770e-4c8a-9ee3-9025fd965948 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Created volume successfully.
Sep 10 11:30:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-9aeb413c-3b4a-4b53-8a97-34a068b7fe31 req-bbc89913-03a2-4020-9033-ae34c63ff4c7 tempest-AttachVolumeTestJSON-901448073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:30:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-9aeb413c-3b4a-4b53-8a97-34a068b7fe31 req-bbc89913-03a2-4020-9033-ae34c63ff4c7 tempest-AttachVolumeTestJSON-901448073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:30:37 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b8ecef-2b1e-4214-94a3-378f518b68a5]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:30:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-9aeb413c-3b4a-4b53-8a97-34a068b7fe31 req-bbc89913-03a2-4020-9033-ae34c63ff4c7 tempest-AttachVolumeTestJSON-901448073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6b8d08b8-0017-496b-90af-cbbe695f8396 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:30:37 devstack quobyte-client[82616]: System call of process 86547 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:30:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-9aeb413c-3b4a-4b53-8a97-34a068b7fe31 req-bbc89913-03a2-4020-9033-ae34c63ff4c7 tempest-AttachVolumeTestJSON-901448073 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6b8d08b8-0017-496b-90af-cbbe695f8396" returned: 0 in 0.665s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:30:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-9aeb413c-3b4a-4b53-8a97-34a068b7fe31 req-bbc89913-03a2-4020-9033-ae34c63ff4c7 tempest-AttachVolumeTestJSON-901448073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.787s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:30:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-9aeb413c-3b4a-4b53-8a97-34a068b7fe31 req-bbc89913-03a2-4020-9033-ae34c63ff4c7 tempest-AttachVolumeTestJSON-901448073 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56', 'name': 'volume-6b8d08b8-0017-496b-90af-cbbe695f8396', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb59cbed-3731-445a-aaef-9a82b652d7f5', 'enforce_multipath': True} {{(pid=82594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 11:30:38 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-9aeb413c-3b4a-4b53-8a97-34a068b7fe31 req-bbc89913-03a2-4020-9033-ae34c63ff4c7 tempest-AttachVolumeTestJSON-901448073 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:30:38 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-9aeb413c-3b4a-4b53-8a97-34a068b7fe31 req-bbc89913-03a2-4020-9033-ae34c63ff4c7 tempest-AttachVolumeTestJSON-901448073 None] attachment_update completed successfully.
Sep 10 11:30:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-59f7e443-dd71-4f75-a368-a7d851a576a1 req-647e25de-5b58-4625-97b1-f75b3f2ba6d1 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:30:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-59f7e443-dd71-4f75-a368-a7d851a576a1 req-647e25de-5b58-4625-97b1-f75b3f2ba6d1 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:30:38 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[096c15a1-b986-446b-b86f-dd7c91cb8822]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:30:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-59f7e443-dd71-4f75-a368-a7d851a576a1 req-647e25de-5b58-4625-97b1-f75b3f2ba6d1 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-cf5841d0-382c-4d1a-a2c8-51f1ae7556be {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:30:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-59f7e443-dd71-4f75-a368-a7d851a576a1 req-647e25de-5b58-4625-97b1-f75b3f2ba6d1 tempest-AttachSCSIVolumeTestJSON-1362798817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-cf5841d0-382c-4d1a-a2c8-51f1ae7556be" returned: 0 in 0.591s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:30:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-59f7e443-dd71-4f75-a368-a7d851a576a1 req-647e25de-5b58-4625-97b1-f75b3f2ba6d1 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.667s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:30:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-59f7e443-dd71-4f75-a368-a7d851a576a1 req-647e25de-5b58-4625-97b1-f75b3f2ba6d1 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56', 'name': 'volume-cf5841d0-382c-4d1a-a2c8-51f1ae7556be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c27fbf8f-cfa8-404c-980b-4fe35928efb5', 'enforce_multipath': True} {{(pid=82594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 11:30:39 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-59f7e443-dd71-4f75-a368-a7d851a576a1 req-647e25de-5b58-4625-97b1-f75b3f2ba6d1 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:30:39 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-59f7e443-dd71-4f75-a368-a7d851a576a1 req-647e25de-5b58-4625-97b1-f75b3f2ba6d1 tempest-AttachSCSIVolumeTestJSON-1362798817 None] attachment_update completed successfully.
Sep 10 11:30:49 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=11,cinder:SELECT=13,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:30:49 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=13,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:31:10 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-d4538895-142b-47ff-a4ed-0b89041b57bf req-7d8fb95e-cf62-4ff8-b356-c50983cf20c4 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:31:10 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-d4538895-142b-47ff-a4ed-0b89041b57bf req-7d8fb95e-cf62-4ff8-b356-c50983cf20c4 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:31:10 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-d4538895-142b-47ff-a4ed-0b89041b57bf req-7d8fb95e-cf62-4ff8-b356-c50983cf20c4 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Terminate volume connection completed successfully.
Sep 10 11:31:10 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-d4538895-142b-47ff-a4ed-0b89041b57bf req-7d8fb95e-cf62-4ff8-b356-c50983cf20c4 tempest-AttachSCSIVolumeTestJSON-1362798817 None] Deleting attachment c27fbf8f-cfa8-404c-980b-4fe35928efb5. {{(pid=82594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 11:31:20 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:31:20 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:31:21 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:31:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:31:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:31:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:31:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:31:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:31:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:31:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.222s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:31:22 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:31:27 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6cfdd7c2-3250-4d57-8062-9041a91728bc tempest-AttachSCSIVolumeTestJSON-1362798817 None] Acquiring lock "cinder-cf5841d0-382c-4d1a-a2c8-51f1ae7556be-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:31:27 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6cfdd7c2-3250-4d57-8062-9041a91728bc tempest-AttachSCSIVolumeTestJSON-1362798817 None] Lock "cinder-cf5841d0-382c-4d1a-a2c8-51f1ae7556be-delete_volume" acquired by "delete_volume" :: waited 0.121s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:31:27 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-6cfdd7c2-3250-4d57-8062-9041a91728bc tempest-AttachSCSIVolumeTestJSON-1362798817 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:31:27 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6cfdd7c2-3250-4d57-8062-9041a91728bc tempest-AttachSCSIVolumeTestJSON-1362798817 None] Acquiring lock "cinder-quobyte-cf5841d0-382c-4d1a-a2c8-51f1ae7556be" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:31:27 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6cfdd7c2-3250-4d57-8062-9041a91728bc tempest-AttachSCSIVolumeTestJSON-1362798817 None] Lock "cinder-quobyte-cf5841d0-382c-4d1a-a2c8-51f1ae7556be" acquired by "delete_volume" :: waited 0.018s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:31:27 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd81852-7aa2-4872-9b1f-3fb3089e0d9d]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:31:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6cfdd7c2-3250-4d57-8062-9041a91728bc tempest-AttachSCSIVolumeTestJSON-1362798817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-cf5841d0-382c-4d1a-a2c8-51f1ae7556be {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:31:28 devstack quobyte-client[82616]: System call of process 86836 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:31:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6cfdd7c2-3250-4d57-8062-9041a91728bc tempest-AttachSCSIVolumeTestJSON-1362798817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-cf5841d0-382c-4d1a-a2c8-51f1ae7556be" returned: 0 in 0.895s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:31:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6cfdd7c2-3250-4d57-8062-9041a91728bc tempest-AttachSCSIVolumeTestJSON-1362798817 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-cf5841d0-382c-4d1a-a2c8-51f1ae7556be {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:31:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6cfdd7c2-3250-4d57-8062-9041a91728bc tempest-AttachSCSIVolumeTestJSON-1362798817 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-cf5841d0-382c-4d1a-a2c8-51f1ae7556be" returned: 0 in 0.167s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:31:28 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6cfdd7c2-3250-4d57-8062-9041a91728bc tempest-AttachSCSIVolumeTestJSON-1362798817 None] Lock "cinder-quobyte-cf5841d0-382c-4d1a-a2c8-51f1ae7556be" released by "delete_volume" :: held 1.284s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:31:28 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-6cfdd7c2-3250-4d57-8062-9041a91728bc tempest-AttachSCSIVolumeTestJSON-1362798817 None] Created reservations ['ffb2accc-ac65-411c-853a-329fc53c8671', 'cca7b314-cfaa-4fdf-801d-cdbba74e63fe', '7b3fa305-25bc-438f-8889-c99f1f5272a3', 'f6936f20-8ffc-4e8c-973e-03c8686f14b9'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:31:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6cfdd7c2-3250-4d57-8062-9041a91728bc tempest-AttachSCSIVolumeTestJSON-1362798817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:31:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6cfdd7c2-3250-4d57-8062-9041a91728bc tempest-AttachSCSIVolumeTestJSON-1362798817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:31:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6cfdd7c2-3250-4d57-8062-9041a91728bc tempest-AttachSCSIVolumeTestJSON-1362798817 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:31:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6cfdd7c2-3250-4d57-8062-9041a91728bc tempest-AttachSCSIVolumeTestJSON-1362798817 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:31:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6cfdd7c2-3250-4d57-8062-9041a91728bc tempest-AttachSCSIVolumeTestJSON-1362798817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:31:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6cfdd7c2-3250-4d57-8062-9041a91728bc tempest-AttachSCSIVolumeTestJSON-1362798817 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:31:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6cfdd7c2-3250-4d57-8062-9041a91728bc tempest-AttachSCSIVolumeTestJSON-1362798817 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.404s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:31:29 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-6cfdd7c2-3250-4d57-8062-9041a91728bc tempest-AttachSCSIVolumeTestJSON-1362798817 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:31:29 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-6cfdd7c2-3250-4d57-8062-9041a91728bc tempest-AttachSCSIVolumeTestJSON-1362798817 None] Deleted volume successfully.
Sep 10 11:31:30 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6cfdd7c2-3250-4d57-8062-9041a91728bc tempest-AttachSCSIVolumeTestJSON-1362798817 None] Lock "cinder-cf5841d0-382c-4d1a-a2c8-51f1ae7556be-delete_volume" released by "delete_volume" :: held 3.062s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:31:39 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=8 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:31:40 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=8,cinder:SELECT=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:32:15 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:32:16 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:32:21 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:32:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:32:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:32:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:32:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:32:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.062s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:32:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:32:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.496s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:32:22 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:32:29 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-e542fcd0-8cdf-46fd-8747-60e3eff918a3 req-0e9809c2-1134-4d8e-8cb1-5cc34a510edd tempest-TaggedBootDevicesTest-820793285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:32:29 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-e542fcd0-8cdf-46fd-8747-60e3eff918a3 req-0e9809c2-1134-4d8e-8cb1-5cc34a510edd tempest-TaggedBootDevicesTest-820793285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:32:29 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-e542fcd0-8cdf-46fd-8747-60e3eff918a3 req-0e9809c2-1134-4d8e-8cb1-5cc34a510edd tempest-TaggedBootDevicesTest-820793285 None] Terminate volume connection completed successfully.
Sep 10 11:32:29 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-e542fcd0-8cdf-46fd-8747-60e3eff918a3 req-0e9809c2-1134-4d8e-8cb1-5cc34a510edd tempest-TaggedBootDevicesTest-820793285 None] Deleting attachment 23143ff2-2ea4-4e39-b529-2dce56b06d6b. {{(pid=82594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 11:32:30 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-e542fcd0-8cdf-46fd-8747-60e3eff918a3 req-ab089700-dff2-4907-89c4-cd80ef283372 tempest-TaggedBootDevicesTest-820793285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:32:30 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-e542fcd0-8cdf-46fd-8747-60e3eff918a3 req-ab089700-dff2-4907-89c4-cd80ef283372 tempest-TaggedBootDevicesTest-820793285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:32:30 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-e542fcd0-8cdf-46fd-8747-60e3eff918a3 req-ab089700-dff2-4907-89c4-cd80ef283372 tempest-TaggedBootDevicesTest-820793285 None] Terminate volume connection completed successfully.
Sep 10 11:32:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-e542fcd0-8cdf-46fd-8747-60e3eff918a3 req-ab089700-dff2-4907-89c4-cd80ef283372 tempest-TaggedBootDevicesTest-820793285 None] Deleting attachment 7b0400f3-66e9-40f6-8578-85e4846aa68d. {{(pid=82594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 11:32:30 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-e542fcd0-8cdf-46fd-8747-60e3eff918a3 req-0bad803c-7688-4216-8d80-fd4d54f69944 tempest-TaggedBootDevicesTest-820793285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:32:30 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-e542fcd0-8cdf-46fd-8747-60e3eff918a3 req-0bad803c-7688-4216-8d80-fd4d54f69944 tempest-TaggedBootDevicesTest-820793285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:32:30 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-e542fcd0-8cdf-46fd-8747-60e3eff918a3 req-0bad803c-7688-4216-8d80-fd4d54f69944 tempest-TaggedBootDevicesTest-820793285 None] Terminate volume connection completed successfully.
Sep 10 11:32:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-e542fcd0-8cdf-46fd-8747-60e3eff918a3 req-0bad803c-7688-4216-8d80-fd4d54f69944 tempest-TaggedBootDevicesTest-820793285 None] Deleting attachment 87120501-204e-4e79-99da-d1f88f86d791. {{(pid=82594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 11:32:40 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=3 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:32:40 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=3 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:32:42 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bbbd5ec1-c0f7-4a9d-b90a-dd0c6ab63568 tempest-TaggedBootDevicesTest-820793285 None] Acquiring lock "cinder-1105e0bd-dbe3-45d1-b2bd-7864d0612ed4-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:32:42 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bbbd5ec1-c0f7-4a9d-b90a-dd0c6ab63568 tempest-TaggedBootDevicesTest-820793285 None] Lock "cinder-1105e0bd-dbe3-45d1-b2bd-7864d0612ed4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:32:42 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-bbbd5ec1-c0f7-4a9d-b90a-dd0c6ab63568 tempest-TaggedBootDevicesTest-820793285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:32:42 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bbbd5ec1-c0f7-4a9d-b90a-dd0c6ab63568 tempest-TaggedBootDevicesTest-820793285 None] Acquiring lock "cinder-quobyte-1105e0bd-dbe3-45d1-b2bd-7864d0612ed4" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:32:42 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bbbd5ec1-c0f7-4a9d-b90a-dd0c6ab63568 tempest-TaggedBootDevicesTest-820793285 None] Lock "cinder-quobyte-1105e0bd-dbe3-45d1-b2bd-7864d0612ed4" acquired by "delete_volume" :: waited 0.014s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:32:42 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb561b3c-c61c-4f89-886e-95f30ce6e09b]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:32:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bbbd5ec1-c0f7-4a9d-b90a-dd0c6ab63568 tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1105e0bd-dbe3-45d1-b2bd-7864d0612ed4 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:32:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bbbd5ec1-c0f7-4a9d-b90a-dd0c6ab63568 tempest-TaggedBootDevicesTest-820793285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1105e0bd-dbe3-45d1-b2bd-7864d0612ed4" returned: 0 in 0.516s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:32:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bbbd5ec1-c0f7-4a9d-b90a-dd0c6ab63568 tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1105e0bd-dbe3-45d1-b2bd-7864d0612ed4 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:32:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bbbd5ec1-c0f7-4a9d-b90a-dd0c6ab63568 tempest-TaggedBootDevicesTest-820793285 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1105e0bd-dbe3-45d1-b2bd-7864d0612ed4" returned: 0 in 0.083s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:32:42 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bbbd5ec1-c0f7-4a9d-b90a-dd0c6ab63568 tempest-TaggedBootDevicesTest-820793285 None] Lock "cinder-quobyte-1105e0bd-dbe3-45d1-b2bd-7864d0612ed4" released by "delete_volume" :: held 0.756s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:32:43 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-bbbd5ec1-c0f7-4a9d-b90a-dd0c6ab63568 tempest-TaggedBootDevicesTest-820793285 None] Created reservations ['dea2eb5e-0cc5-4187-8803-f5665cf7b7df', '1c6b8210-9ef0-4093-bbe0-94a822276df8', '7e45429a-6664-4252-a35e-e1e15a347db0', 'a9132aef-cf93-4f0c-b86e-86e1dbda4abb'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:32:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bbbd5ec1-c0f7-4a9d-b90a-dd0c6ab63568 tempest-TaggedBootDevicesTest-820793285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:32:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bbbd5ec1-c0f7-4a9d-b90a-dd0c6ab63568 tempest-TaggedBootDevicesTest-820793285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:32:43 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bbbd5ec1-c0f7-4a9d-b90a-dd0c6ab63568 tempest-TaggedBootDevicesTest-820793285 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:32:43 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bbbd5ec1-c0f7-4a9d-b90a-dd0c6ab63568 tempest-TaggedBootDevicesTest-820793285 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:32:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bbbd5ec1-c0f7-4a9d-b90a-dd0c6ab63568 tempest-TaggedBootDevicesTest-820793285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:32:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bbbd5ec1-c0f7-4a9d-b90a-dd0c6ab63568 tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:32:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bbbd5ec1-c0f7-4a9d-b90a-dd0c6ab63568 tempest-TaggedBootDevicesTest-820793285 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.110s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:32:43 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bbbd5ec1-c0f7-4a9d-b90a-dd0c6ab63568 tempest-TaggedBootDevicesTest-820793285 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:32:43 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-bbbd5ec1-c0f7-4a9d-b90a-dd0c6ab63568 tempest-TaggedBootDevicesTest-820793285 None] Deleted volume successfully.
Sep 10 11:32:43 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bbbd5ec1-c0f7-4a9d-b90a-dd0c6ab63568 tempest-TaggedBootDevicesTest-820793285 None] Lock "cinder-1105e0bd-dbe3-45d1-b2bd-7864d0612ed4-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:32:44 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2477ffbe-6bd5-42e5-8a20-2813de57b66c tempest-TaggedBootDevicesTest-820793285 None] Acquiring lock "cinder-2365fdcc-1e80-4c3b-8538-eb8b97bc2449-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:32:44 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2477ffbe-6bd5-42e5-8a20-2813de57b66c tempest-TaggedBootDevicesTest-820793285 None] Lock "cinder-2365fdcc-1e80-4c3b-8538-eb8b97bc2449-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:32:45 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-2477ffbe-6bd5-42e5-8a20-2813de57b66c tempest-TaggedBootDevicesTest-820793285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:32:45 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2477ffbe-6bd5-42e5-8a20-2813de57b66c tempest-TaggedBootDevicesTest-820793285 None] Acquiring lock "cinder-quobyte-2365fdcc-1e80-4c3b-8538-eb8b97bc2449" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:32:45 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2477ffbe-6bd5-42e5-8a20-2813de57b66c tempest-TaggedBootDevicesTest-820793285 None] Lock "cinder-quobyte-2365fdcc-1e80-4c3b-8538-eb8b97bc2449" acquired by "delete_volume" :: waited 0.038s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:32:45 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa73c50a-7c74-434f-91ef-83afc5a10135]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:32:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2477ffbe-6bd5-42e5-8a20-2813de57b66c tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2365fdcc-1e80-4c3b-8538-eb8b97bc2449 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:32:45 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-b3e387d7-10ee-473e-98da-2e0fbfa91410 req-462e5a2c-7210-4b1b-a6f4-bac1333cb923 tempest-AttachVolumeTestJSON-901448073 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:32:46 devstack quobyte-client[82616]: System call of process 87424 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:32:46 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-b3e387d7-10ee-473e-98da-2e0fbfa91410 req-462e5a2c-7210-4b1b-a6f4-bac1333cb923 tempest-AttachVolumeTestJSON-901448073 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:32:46 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-b3e387d7-10ee-473e-98da-2e0fbfa91410 req-462e5a2c-7210-4b1b-a6f4-bac1333cb923 tempest-AttachVolumeTestJSON-901448073 None] Terminate volume connection completed successfully.
Sep 10 11:32:46 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-b3e387d7-10ee-473e-98da-2e0fbfa91410 req-462e5a2c-7210-4b1b-a6f4-bac1333cb923 tempest-AttachVolumeTestJSON-901448073 None] Deleting attachment cb59cbed-3731-445a-aaef-9a82b652d7f5. {{(pid=82594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 11:32:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2477ffbe-6bd5-42e5-8a20-2813de57b66c tempest-TaggedBootDevicesTest-820793285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2365fdcc-1e80-4c3b-8538-eb8b97bc2449" returned: 0 in 1.164s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:32:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2477ffbe-6bd5-42e5-8a20-2813de57b66c tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2365fdcc-1e80-4c3b-8538-eb8b97bc2449 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:32:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2477ffbe-6bd5-42e5-8a20-2813de57b66c tempest-TaggedBootDevicesTest-820793285 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2365fdcc-1e80-4c3b-8538-eb8b97bc2449" returned: 0 in 0.204s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:32:46 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2477ffbe-6bd5-42e5-8a20-2813de57b66c tempest-TaggedBootDevicesTest-820793285 None] Lock "cinder-quobyte-2365fdcc-1e80-4c3b-8538-eb8b97bc2449" released by "delete_volume" :: held 1.532s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:32:47 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-2477ffbe-6bd5-42e5-8a20-2813de57b66c tempest-TaggedBootDevicesTest-820793285 None] Created reservations ['a98a0c98-8d2c-4122-9b0d-d1f388eabd92', 'c4ed2bd0-4b0c-47b0-aeca-b85d558701fb', '74b5f638-5ba3-4c07-8658-49fdd476d3d4', 'c874b729-3d11-4291-a532-415e3eadc6a1'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:32:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2477ffbe-6bd5-42e5-8a20-2813de57b66c tempest-TaggedBootDevicesTest-820793285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:32:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2477ffbe-6bd5-42e5-8a20-2813de57b66c tempest-TaggedBootDevicesTest-820793285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:32:47 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2477ffbe-6bd5-42e5-8a20-2813de57b66c tempest-TaggedBootDevicesTest-820793285 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:32:47 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2477ffbe-6bd5-42e5-8a20-2813de57b66c tempest-TaggedBootDevicesTest-820793285 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:32:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2477ffbe-6bd5-42e5-8a20-2813de57b66c tempest-TaggedBootDevicesTest-820793285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:32:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2477ffbe-6bd5-42e5-8a20-2813de57b66c tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:32:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2477ffbe-6bd5-42e5-8a20-2813de57b66c tempest-TaggedBootDevicesTest-820793285 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.169s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:32:47 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-2477ffbe-6bd5-42e5-8a20-2813de57b66c tempest-TaggedBootDevicesTest-820793285 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:32:47 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-2477ffbe-6bd5-42e5-8a20-2813de57b66c tempest-TaggedBootDevicesTest-820793285 None] Deleted volume successfully.
Sep 10 11:32:47 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2477ffbe-6bd5-42e5-8a20-2813de57b66c tempest-TaggedBootDevicesTest-820793285 None] Lock "cinder-2365fdcc-1e80-4c3b-8538-eb8b97bc2449-delete_volume" released by "delete_volume" :: held 3.069s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:32:48 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a58e2f78-f34f-481b-bf64-28871f55b0a7 tempest-TaggedBootDevicesTest-820793285 None] Acquiring lock "cinder-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:32:48 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a58e2f78-f34f-481b-bf64-28871f55b0a7 tempest-TaggedBootDevicesTest-820793285 None] Lock "cinder-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:32:48 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-a58e2f78-f34f-481b-bf64-28871f55b0a7 tempest-TaggedBootDevicesTest-820793285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:32:48 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a58e2f78-f34f-481b-bf64-28871f55b0a7 tempest-TaggedBootDevicesTest-820793285 None] Acquiring lock "cinder-quobyte-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:32:48 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a58e2f78-f34f-481b-bf64-28871f55b0a7 tempest-TaggedBootDevicesTest-820793285 None] Lock "cinder-quobyte-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28" acquired by "delete_volume" :: waited 0.023s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:32:48 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6c2966-75d5-4b6e-8d64-d79a13d72465]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:32:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a58e2f78-f34f-481b-bf64-28871f55b0a7 tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:32:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a58e2f78-f34f-481b-bf64-28871f55b0a7 tempest-TaggedBootDevicesTest-820793285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28" returned: 0 in 0.536s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:32:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a58e2f78-f34f-481b-bf64-28871f55b0a7 tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:32:50 devstack quobyte-client[82616]: System call of process 87435 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:32:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a58e2f78-f34f-481b-bf64-28871f55b0a7 tempest-TaggedBootDevicesTest-820793285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28" returned: 1 in 1.614s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:32:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a58e2f78-f34f-481b-bf64-28871f55b0a7 tempest-TaggedBootDevicesTest-820793285 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 11:32:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a58e2f78-f34f-481b-bf64-28871f55b0a7 tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:32:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a58e2f78-f34f-481b-bf64-28871f55b0a7 tempest-TaggedBootDevicesTest-820793285 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28" returned: 0 in 0.192s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:32:51 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a58e2f78-f34f-481b-bf64-28871f55b0a7 tempest-TaggedBootDevicesTest-820793285 None] Lock "cinder-quobyte-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28" released by "delete_volume" :: held 2.714s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:32:51 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-a58e2f78-f34f-481b-bf64-28871f55b0a7 tempest-TaggedBootDevicesTest-820793285 None] Created reservations ['dafc821c-7596-4510-8e61-f36cb95c1a2e', '5dfcaee8-47a7-4b3f-8bbb-96cd9eaa5dcc', 'abac97a9-174d-49f0-a497-1bbb9870e4cc', '2e2aa605-955e-4309-8b10-5bca8e508ce6'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:32:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a58e2f78-f34f-481b-bf64-28871f55b0a7 tempest-TaggedBootDevicesTest-820793285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:32:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a58e2f78-f34f-481b-bf64-28871f55b0a7 tempest-TaggedBootDevicesTest-820793285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:32:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-a58e2f78-f34f-481b-bf64-28871f55b0a7 tempest-TaggedBootDevicesTest-820793285 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:32:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-a58e2f78-f34f-481b-bf64-28871f55b0a7 tempest-TaggedBootDevicesTest-820793285 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:32:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a58e2f78-f34f-481b-bf64-28871f55b0a7 tempest-TaggedBootDevicesTest-820793285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:32:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a58e2f78-f34f-481b-bf64-28871f55b0a7 tempest-TaggedBootDevicesTest-820793285 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:32:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a58e2f78-f34f-481b-bf64-28871f55b0a7 tempest-TaggedBootDevicesTest-820793285 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.105s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:32:51 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-a58e2f78-f34f-481b-bf64-28871f55b0a7 tempest-TaggedBootDevicesTest-820793285 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:32:51 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-a58e2f78-f34f-481b-bf64-28871f55b0a7 tempest-TaggedBootDevicesTest-820793285 None] Deleted volume successfully.
Sep 10 11:32:52 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a58e2f78-f34f-481b-bf64-28871f55b0a7 tempest-TaggedBootDevicesTest-820793285 None] Lock "cinder-1b6b1c80-9c4b-47fa-8510-f8a6c1efeb28-delete_volume" released by "delete_volume" :: held 3.705s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:33:01 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=26,cinder:SELECT=17,cinder:INSERT=7 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:33:02 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=15,cinder:INSERT=5,cinder:UPDATE=22,cinder:DELETE=3 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:33:21 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:33:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:33:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:33:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:33:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:33:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:33:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:33:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.177s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:33:22 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:33:52 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:33:52 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:33:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Flow 'volume_create_manager' (fe2b82d9-6ea3-4a4d-b56c-d92cfeccc30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:33:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68dbb37f-8e96-4641-b418-ca70d3a8a279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:33:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68dbb37f-8e96-4641-b418-ca70d3a8a279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-861550098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a524670-8b5e-4439-8c2d-0a9f945a067f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e039e2c721a49bc8c57fb0009d5d067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:33:52Z,use_quota=True,user_id='189699eda7464e51ad15a2df6c990bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:33:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d50ce98d-d916-4320-aa00-a71610474b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:33:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d50ce98d-d916-4320-aa00-a71610474b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:33:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f95038bb-345b-4279-81f5-169a45d5c012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:33:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f95038bb-345b-4279-81f5-169a45d5c012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a524670-8b5e-4439-8c2d-0a9f945a067f', 'volume_name': 'volume-5a524670-8b5e-4439-8c2d-0a9f945a067f', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:33:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302286d5-a330-45e7-9ef9-29b578d24e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:33:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302286d5-a330-45e7-9ef9-29b578d24e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:33:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d57a1373-2028-4664-aaf1-51c90e293ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:33:52 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Volume 5a524670-8b5e-4439-8c2d-0a9f945a067f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a524670-8b5e-4439-8c2d-0a9f945a067f', 'volume_size': 1}
Sep 10 11:33:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:33:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:33:52 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-861550098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a524670-8b5e-4439-8c2d-0a9f945a067f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e039e2c721a49bc8c57fb0009d5d067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:33:52Z,use_quota=True,user_id='189699eda7464e51ad15a2df6c990bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:33:52 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Creating volume 5a524670-8b5e-4439-8c2d-0a9f945a067f {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:33:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:33:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:33:52 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:33:52 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:33:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:33:52 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:33:52 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:33:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5a524670-8b5e-4439-8c2d-0a9f945a067f 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:33:53 devstack quobyte-client[82616]: System call of process 87735 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:33:53 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=11, name=volume-5a524670-8b5e-4439-8c2d-0a9f945a067f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:33:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5a524670-8b5e-4439-8c2d-0a9f945a067f 1073741824" returned: 0 in 2.089s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:33:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5a524670-8b5e-4439-8c2d-0a9f945a067f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:33:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5a524670-8b5e-4439-8c2d-0a9f945a067f" returned: 0 in 0.712s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:33:55 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] <== create_volume: return (3138ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:33:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.172s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:33:56 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d57a1373-2028-4664-aaf1-51c90e293ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a524670-8b5e-4439-8c2d-0a9f945a067f', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:33:56 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b4cb9e3-af33-441c-b752-d80b82705d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:33:57 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Volume volume-5a524670-8b5e-4439-8c2d-0a9f945a067f (5a524670-8b5e-4439-8c2d-0a9f945a067f): created successfully
Sep 10 11:33:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b4cb9e3-af33-441c-b752-d80b82705d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:33:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Flow 'volume_create_manager' (fe2b82d9-6ea3-4a4d-b56c-d92cfeccc30d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:33:57 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-1388b913-fb9e-425b-aa96-107c9e08e673 tempest-AttachVolumeShelveTestJSON-1374435819 None] Created volume successfully.
Sep 10 11:34:15 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:34:15 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:34:21 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:34:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:34:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:34:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:34:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:34:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:34:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:34:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.515s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:34:22 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:34:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-55e868f6-68a8-4cd9-bdcb-ac4e8f74bdd7 req-7a408284-7a3f-45f3-9f86-bc407efac2e5 tempest-AttachVolumeShelveTestJSON-1374435819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:34:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-55e868f6-68a8-4cd9-bdcb-ac4e8f74bdd7 req-7a408284-7a3f-45f3-9f86-bc407efac2e5 tempest-AttachVolumeShelveTestJSON-1374435819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:34:50 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae945e1-1aa5-43cc-8417-fb7ef4589194]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:34:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-55e868f6-68a8-4cd9-bdcb-ac4e8f74bdd7 req-7a408284-7a3f-45f3-9f86-bc407efac2e5 tempest-AttachVolumeShelveTestJSON-1374435819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5a524670-8b5e-4439-8c2d-0a9f945a067f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:34:50 devstack quobyte-client[82616]: System call of process 88110 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:34:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-55e868f6-68a8-4cd9-bdcb-ac4e8f74bdd7 req-7a408284-7a3f-45f3-9f86-bc407efac2e5 tempest-AttachVolumeShelveTestJSON-1374435819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5a524670-8b5e-4439-8c2d-0a9f945a067f" returned: 0 in 0.934s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:34:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-55e868f6-68a8-4cd9-bdcb-ac4e8f74bdd7 req-7a408284-7a3f-45f3-9f86-bc407efac2e5 tempest-AttachVolumeShelveTestJSON-1374435819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.054s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:34:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-55e868f6-68a8-4cd9-bdcb-ac4e8f74bdd7 req-7a408284-7a3f-45f3-9f86-bc407efac2e5 tempest-AttachVolumeShelveTestJSON-1374435819 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56', 'name': 'volume-5a524670-8b5e-4439-8c2d-0a9f945a067f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '030fbaa8-e6e7-4faf-a5ae-a73d52195eb7', 'enforce_multipath': True} {{(pid=82594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 11:34:51 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-55e868f6-68a8-4cd9-bdcb-ac4e8f74bdd7 req-7a408284-7a3f-45f3-9f86-bc407efac2e5 tempest-AttachVolumeShelveTestJSON-1374435819 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:34:51 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-55e868f6-68a8-4cd9-bdcb-ac4e8f74bdd7 req-7a408284-7a3f-45f3-9f86-bc407efac2e5 tempest-AttachVolumeShelveTestJSON-1374435819 None] attachment_update completed successfully.
Sep 10 11:35:01 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=6 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:35:01 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:35:02 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:35:02 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:35:02 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Flow 'volume_create_manager' (5dd8d089-cc8e-464a-8c50-6eab00679d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:35:02 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d836503-7115-4888-b280-25d4cf99d6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:35:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d836503-7115-4888-b280-25d4cf99d6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-266227387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=375a8254-490c-4575-a7b9-281e75abf7c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1de0a8acf054df9af4ba8effe87cc27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:35:03Z,use_quota=True,user_id='92ceac2d37ff47f3946418bcb99074cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:35:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee6d760-131b-4d7c-9fbb-405f25b3a8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:35:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee6d760-131b-4d7c-9fbb-405f25b3a8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:35:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a174a83-d16c-4820-b74b-0c2228f17843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:35:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a174a83-d16c-4820-b74b-0c2228f17843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '375a8254-490c-4575-a7b9-281e75abf7c6', 'volume_name': 'volume-375a8254-490c-4575-a7b9-281e75abf7c6', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:35:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a0737e-3513-4bb9-84e8-59b992a95afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:35:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a0737e-3513-4bb9-84e8-59b992a95afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:35:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dfc38d5-cbd0-412f-9445-07a39dc944d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:35:03 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Volume 375a8254-490c-4575-a7b9-281e75abf7c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-375a8254-490c-4575-a7b9-281e75abf7c6', 'volume_size': 1}
Sep 10 11:35:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:35:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:35:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-266227387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=375a8254-490c-4575-a7b9-281e75abf7c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1de0a8acf054df9af4ba8effe87cc27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:35:03Z,use_quota=True,user_id='92ceac2d37ff47f3946418bcb99074cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:35:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Creating volume 375a8254-490c-4575-a7b9-281e75abf7c6 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:35:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:35:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:35:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:35:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:35:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:35:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:35:03 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:35:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-375a8254-490c-4575-a7b9-281e75abf7c6 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:35:03 devstack quobyte-client[82616]: System call of process 88170 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:35:03 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=12, name=volume-375a8254-490c-4575-a7b9-281e75abf7c6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:35:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-375a8254-490c-4575-a7b9-281e75abf7c6 1073741824" returned: 0 in 1.283s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:35:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-375a8254-490c-4575-a7b9-281e75abf7c6 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:35:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-375a8254-490c-4575-a7b9-281e75abf7c6" returned: 0 in 0.400s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:35:05 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] <== create_volume: return (1864ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:35:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.914s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:35:05 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dfc38d5-cbd0-412f-9445-07a39dc944d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-375a8254-490c-4575-a7b9-281e75abf7c6', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:35:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be8cb1b-8a4a-4c44-8cea-65a0c971176a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:35:06 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Volume volume-375a8254-490c-4575-a7b9-281e75abf7c6 (375a8254-490c-4575-a7b9-281e75abf7c6): created successfully
Sep 10 11:35:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be8cb1b-8a4a-4c44-8cea-65a0c971176a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:35:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Flow 'volume_create_manager' (5dd8d089-cc8e-464a-8c50-6eab00679d7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:35:06 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-e5ce1016-f06d-4f2a-a95b-a32dc3e085a6 tempest-ServersNegativeTestJSON-833690863 None] Created volume successfully.
Sep 10 11:35:11 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:35:11 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:35:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Flow 'volume_create_manager' (b255cd2c-0b36-4cfb-b512-999d5f990459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:35:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (096faca8-ed52-4eef-9fd9-bdd2e7b1e2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:35:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (096faca8-ed52-4eef-9fd9-bdd2e7b1e2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-801252702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb60e8f-8da5-4ac0-b340-af7052ba592d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1de0a8acf054df9af4ba8effe87cc27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:35:11Z,use_quota=True,user_id='92ceac2d37ff47f3946418bcb99074cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:35:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b3f668-0764-4add-8646-25c9c22910fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:35:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b3f668-0764-4add-8646-25c9c22910fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:35:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7fa8964-9dfb-4913-8aa7-8c0dda5e2047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:35:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7fa8964-9dfb-4913-8aa7-8c0dda5e2047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eb60e8f-8da5-4ac0-b340-af7052ba592d', 'volume_name': 'volume-3eb60e8f-8da5-4ac0-b340-af7052ba592d', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:35:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d36265c-6b28-4e54-a4f1-28c0fc44fde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:35:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d36265c-6b28-4e54-a4f1-28c0fc44fde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:35:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d81c7e59-782e-47f9-a7c2-c8231f1cca85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:35:11 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Volume 3eb60e8f-8da5-4ac0-b340-af7052ba592d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eb60e8f-8da5-4ac0-b340-af7052ba592d', 'volume_size': 1}
Sep 10 11:35:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:35:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:35:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-801252702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb60e8f-8da5-4ac0-b340-af7052ba592d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1de0a8acf054df9af4ba8effe87cc27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:35:11Z,use_quota=True,user_id='92ceac2d37ff47f3946418bcb99074cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:35:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Creating volume 3eb60e8f-8da5-4ac0-b340-af7052ba592d {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:35:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:35:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:35:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:35:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:35:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:35:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:35:11 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:35:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3eb60e8f-8da5-4ac0-b340-af7052ba592d 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:35:12 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=13, name=volume-3eb60e8f-8da5-4ac0-b340-af7052ba592d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:35:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3eb60e8f-8da5-4ac0-b340-af7052ba592d 1073741824" returned: 0 in 0.681s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:35:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3eb60e8f-8da5-4ac0-b340-af7052ba592d {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:35:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3eb60e8f-8da5-4ac0-b340-af7052ba592d" returned: 0 in 0.150s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:35:12 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] <== create_volume: return (907ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:35:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:35:13 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d81c7e59-782e-47f9-a7c2-c8231f1cca85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eb60e8f-8da5-4ac0-b340-af7052ba592d', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:35:13 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854cb121-1762-4363-b1df-ed53f3c1bff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:35:13 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Volume volume-3eb60e8f-8da5-4ac0-b340-af7052ba592d (3eb60e8f-8da5-4ac0-b340-af7052ba592d): created successfully
Sep 10 11:35:13 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854cb121-1762-4363-b1df-ed53f3c1bff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:35:13 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Flow 'volume_create_manager' (b255cd2c-0b36-4cfb-b512-999d5f990459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:35:13 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-5e173ed9-2f5c-4030-960e-87fb1241173e tempest-ServersNegativeTestJSON-833690863 None] Created volume successfully.
Sep 10 11:35:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8b07ac52-1c53-4df1-9b09-22855a8e62e2 tempest-ServersNegativeTestJSON-833690863 None] Acquiring lock "cinder-3eb60e8f-8da5-4ac0-b340-af7052ba592d-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:35:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8b07ac52-1c53-4df1-9b09-22855a8e62e2 tempest-ServersNegativeTestJSON-833690863 None] Lock "cinder-3eb60e8f-8da5-4ac0-b340-af7052ba592d-delete_volume" acquired by "delete_volume" :: waited 0.191s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:35:16 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-8b07ac52-1c53-4df1-9b09-22855a8e62e2 tempest-ServersNegativeTestJSON-833690863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:35:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8b07ac52-1c53-4df1-9b09-22855a8e62e2 tempest-ServersNegativeTestJSON-833690863 None] Acquiring lock "cinder-quobyte-3eb60e8f-8da5-4ac0-b340-af7052ba592d" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:35:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8b07ac52-1c53-4df1-9b09-22855a8e62e2 tempest-ServersNegativeTestJSON-833690863 None] Lock "cinder-quobyte-3eb60e8f-8da5-4ac0-b340-af7052ba592d" acquired by "delete_volume" :: waited 0.039s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:35:16 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ced9ad-df6d-4470-bd09-ddf81ddd70ee]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:35:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8b07ac52-1c53-4df1-9b09-22855a8e62e2 tempest-ServersNegativeTestJSON-833690863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3eb60e8f-8da5-4ac0-b340-af7052ba592d {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:35:17 devstack quobyte-client[82616]: System call of process 88211 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:35:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8b07ac52-1c53-4df1-9b09-22855a8e62e2 tempest-ServersNegativeTestJSON-833690863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3eb60e8f-8da5-4ac0-b340-af7052ba592d" returned: 0 in 1.210s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:35:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8b07ac52-1c53-4df1-9b09-22855a8e62e2 tempest-ServersNegativeTestJSON-833690863 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3eb60e8f-8da5-4ac0-b340-af7052ba592d {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:35:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8b07ac52-1c53-4df1-9b09-22855a8e62e2 tempest-ServersNegativeTestJSON-833690863 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3eb60e8f-8da5-4ac0-b340-af7052ba592d" returned: 0 in 0.224s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:35:18 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8b07ac52-1c53-4df1-9b09-22855a8e62e2 tempest-ServersNegativeTestJSON-833690863 None] Lock "cinder-quobyte-3eb60e8f-8da5-4ac0-b340-af7052ba592d" released by "delete_volume" :: held 1.707s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:35:18 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-8b07ac52-1c53-4df1-9b09-22855a8e62e2 tempest-ServersNegativeTestJSON-833690863 None] Created reservations ['8749e0a0-3372-48db-b95a-1e0016f76116', '7c2ba8cf-58b9-46ec-bda3-fc326c0e6c10', 'c902174b-ee79-4389-859b-b5fff777940d', '67892631-5959-4ece-8b53-ccc4ad6eeea1'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:35:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8b07ac52-1c53-4df1-9b09-22855a8e62e2 tempest-ServersNegativeTestJSON-833690863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:35:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8b07ac52-1c53-4df1-9b09-22855a8e62e2 tempest-ServersNegativeTestJSON-833690863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:35:19 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-8b07ac52-1c53-4df1-9b09-22855a8e62e2 tempest-ServersNegativeTestJSON-833690863 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:35:19 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-8b07ac52-1c53-4df1-9b09-22855a8e62e2 tempest-ServersNegativeTestJSON-833690863 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:35:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8b07ac52-1c53-4df1-9b09-22855a8e62e2 tempest-ServersNegativeTestJSON-833690863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.065s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:35:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8b07ac52-1c53-4df1-9b09-22855a8e62e2 tempest-ServersNegativeTestJSON-833690863 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:35:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8b07ac52-1c53-4df1-9b09-22855a8e62e2 tempest-ServersNegativeTestJSON-833690863 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.563s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:35:20 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-8b07ac52-1c53-4df1-9b09-22855a8e62e2 tempest-ServersNegativeTestJSON-833690863 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:35:20 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-8b07ac52-1c53-4df1-9b09-22855a8e62e2 tempest-ServersNegativeTestJSON-833690863 None] Deleted volume successfully.
Sep 10 11:35:20 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9cd6f518-8f9b-4ccf-a000-783a59404fe8 tempest-ServersNegativeTestJSON-833690863 None] Acquiring lock "cinder-375a8254-490c-4575-a7b9-281e75abf7c6-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:35:20 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8b07ac52-1c53-4df1-9b09-22855a8e62e2 tempest-ServersNegativeTestJSON-833690863 None] Lock "cinder-3eb60e8f-8da5-4ac0-b340-af7052ba592d-delete_volume" released by "delete_volume" :: held 4.211s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:35:20 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9cd6f518-8f9b-4ccf-a000-783a59404fe8 tempest-ServersNegativeTestJSON-833690863 None] Lock "cinder-375a8254-490c-4575-a7b9-281e75abf7c6-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:35:20 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-9cd6f518-8f9b-4ccf-a000-783a59404fe8 tempest-ServersNegativeTestJSON-833690863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:35:20 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9cd6f518-8f9b-4ccf-a000-783a59404fe8 tempest-ServersNegativeTestJSON-833690863 None] Acquiring lock "cinder-quobyte-375a8254-490c-4575-a7b9-281e75abf7c6" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:35:20 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9cd6f518-8f9b-4ccf-a000-783a59404fe8 tempest-ServersNegativeTestJSON-833690863 None] Lock "cinder-quobyte-375a8254-490c-4575-a7b9-281e75abf7c6" acquired by "delete_volume" :: waited 0.018s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:35:20 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1dd8a0-5f22-4fb6-a4fc-d0d7b6b76e19]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:35:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9cd6f518-8f9b-4ccf-a000-783a59404fe8 tempest-ServersNegativeTestJSON-833690863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-375a8254-490c-4575-a7b9-281e75abf7c6 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:35:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9cd6f518-8f9b-4ccf-a000-783a59404fe8 tempest-ServersNegativeTestJSON-833690863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-375a8254-490c-4575-a7b9-281e75abf7c6" returned: 0 in 0.983s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:35:21 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:35:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:35:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.024s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:35:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:35:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:35:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:35:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:35:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9cd6f518-8f9b-4ccf-a000-783a59404fe8 tempest-ServersNegativeTestJSON-833690863 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-375a8254-490c-4575-a7b9-281e75abf7c6 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:35:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.316s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:35:22 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:35:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9cd6f518-8f9b-4ccf-a000-783a59404fe8 tempest-ServersNegativeTestJSON-833690863 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-375a8254-490c-4575-a7b9-281e75abf7c6" returned: 0 in 0.333s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:35:22 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9cd6f518-8f9b-4ccf-a000-783a59404fe8 tempest-ServersNegativeTestJSON-833690863 None] Lock "cinder-quobyte-375a8254-490c-4575-a7b9-281e75abf7c6" released by "delete_volume" :: held 1.930s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:35:23 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-9cd6f518-8f9b-4ccf-a000-783a59404fe8 tempest-ServersNegativeTestJSON-833690863 None] Created reservations ['fd9fbc41-3f2a-4085-b88c-780cf84b0cd9', '49c0c08a-df2d-46cf-8197-c550c590abc9', '6ccf2075-f6e2-4a77-bdb0-8a2009240717', 'b7a835f5-bb01-4224-8223-05536683fdd9'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:35:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9cd6f518-8f9b-4ccf-a000-783a59404fe8 tempest-ServersNegativeTestJSON-833690863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:35:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9cd6f518-8f9b-4ccf-a000-783a59404fe8 tempest-ServersNegativeTestJSON-833690863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:35:23 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9cd6f518-8f9b-4ccf-a000-783a59404fe8 tempest-ServersNegativeTestJSON-833690863 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:35:23 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9cd6f518-8f9b-4ccf-a000-783a59404fe8 tempest-ServersNegativeTestJSON-833690863 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:35:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9cd6f518-8f9b-4ccf-a000-783a59404fe8 tempest-ServersNegativeTestJSON-833690863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:35:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9cd6f518-8f9b-4ccf-a000-783a59404fe8 tempest-ServersNegativeTestJSON-833690863 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:35:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9cd6f518-8f9b-4ccf-a000-783a59404fe8 tempest-ServersNegativeTestJSON-833690863 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.193s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:35:23 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-9cd6f518-8f9b-4ccf-a000-783a59404fe8 tempest-ServersNegativeTestJSON-833690863 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:35:23 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-9cd6f518-8f9b-4ccf-a000-783a59404fe8 tempest-ServersNegativeTestJSON-833690863 None] Deleted volume successfully.
Sep 10 11:35:24 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9cd6f518-8f9b-4ccf-a000-783a59404fe8 tempest-ServersNegativeTestJSON-833690863 None] Lock "cinder-375a8254-490c-4575-a7b9-281e75abf7c6-delete_volume" released by "delete_volume" :: held 3.809s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:35:33 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=17,cinder:DELETE=2,cinder:INSERT=8,cinder:UPDATE=20 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:35:34 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=20,cinder:SELECT=7,cinder:DELETE=2 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:36:01 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:36:01 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:36:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Flow 'volume_create_manager' (e72d0bce-ab0a-486b-a406-b0e50a6c499b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:36:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778d4b95-1cf1-4bde-a669-e802d86103fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778d4b95-1cf1-4bde-a669-e802d86103fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-647262516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9db038-98c7-40fa-8bdc-04407d86ac23,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='011c0e4e5ed94726ae686dd8f5acb99b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:36:01Z,use_quota=True,user_id='69fa47f38efa4823877f4342d9967209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7678258-d129-4d57-8e21-9bb7ea500983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7678258-d129-4d57-8e21-9bb7ea500983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ceaa110-e7fe-4388-9177-f5d97b593b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ceaa110-e7fe-4388-9177-f5d97b593b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d9db038-98c7-40fa-8bdc-04407d86ac23', 'volume_name': 'volume-5d9db038-98c7-40fa-8bdc-04407d86ac23', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0baac89-cadd-4f60-90c4-139b64af9d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0baac89-cadd-4f60-90c4-139b64af9d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (681f8c22-2aa9-4530-872e-4554b3dc47d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:01 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Volume 5d9db038-98c7-40fa-8bdc-04407d86ac23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d9db038-98c7-40fa-8bdc-04407d86ac23', 'volume_size': 1}
Sep 10 11:36:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:36:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:36:01 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-647262516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9db038-98c7-40fa-8bdc-04407d86ac23,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='011c0e4e5ed94726ae686dd8f5acb99b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:36:01Z,use_quota=True,user_id='69fa47f38efa4823877f4342d9967209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:36:01 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Creating volume 5d9db038-98c7-40fa-8bdc-04407d86ac23 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:36:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:36:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:36:01 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:36:01 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:36:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:36:01 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:36:01 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:36:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5d9db038-98c7-40fa-8bdc-04407d86ac23 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:02 devstack quobyte-client[82616]: System call of process 88919 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:36:02 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=14, name=volume-5d9db038-98c7-40fa-8bdc-04407d86ac23, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:36:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5d9db038-98c7-40fa-8bdc-04407d86ac23 1073741824" returned: 0 in 0.526s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5d9db038-98c7-40fa-8bdc-04407d86ac23 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5d9db038-98c7-40fa-8bdc-04407d86ac23" returned: 0 in 0.139s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:02 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] <== create_volume: return (790ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:36:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:36:02 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (681f8c22-2aa9-4530-872e-4554b3dc47d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d9db038-98c7-40fa-8bdc-04407d86ac23', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:02 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a043b51-c3a1-418d-bacc-1f082ec5569e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:03 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Volume volume-5d9db038-98c7-40fa-8bdc-04407d86ac23 (5d9db038-98c7-40fa-8bdc-04407d86ac23): created successfully
Sep 10 11:36:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a043b51-c3a1-418d-bacc-1f082ec5569e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Flow 'volume_create_manager' (e72d0bce-ab0a-486b-a406-b0e50a6c499b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:36:03 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-79fac2e6-2d19-41df-a03c-63cd6bf003d9 tempest-VolumesTestJSON-642842873 None] Created volume successfully.
Sep 10 11:36:05 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:36:05 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:36:05 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Flow 'volume_create_manager' (b156b10b-9c30-4ff2-be31-317e9a9d39f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:36:05 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a049f27-bccc-49e4-8e27-f5c4b928ab0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:05 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a049f27-bccc-49e4-8e27-f5c4b928ab0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2051631240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c4c8e4-e08e-4044-bad2-271afc29b623,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='011c0e4e5ed94726ae686dd8f5acb99b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:36:05Z,use_quota=True,user_id='69fa47f38efa4823877f4342d9967209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:05 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c538505-032a-4b31-a35f-08fd5c36a623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:05 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c538505-032a-4b31-a35f-08fd5c36a623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:05 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4259e466-62c7-4360-b308-dbbe0327d612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:05 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4259e466-62c7-4360-b308-dbbe0327d612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07c4c8e4-e08e-4044-bad2-271afc29b623', 'volume_name': 'volume-07c4c8e4-e08e-4044-bad2-271afc29b623', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:05 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8635795e-2437-40ff-8d29-499e87bab3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:05 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8635795e-2437-40ff-8d29-499e87bab3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:05 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e011c0b-24c8-4bde-903c-cad4b0cda084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:05 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Volume 07c4c8e4-e08e-4044-bad2-271afc29b623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07c4c8e4-e08e-4044-bad2-271afc29b623', 'volume_size': 1}
Sep 10 11:36:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:36:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:36:05 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2051631240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c4c8e4-e08e-4044-bad2-271afc29b623,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='011c0e4e5ed94726ae686dd8f5acb99b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:36:05Z,use_quota=True,user_id='69fa47f38efa4823877f4342d9967209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:36:05 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Creating volume 07c4c8e4-e08e-4044-bad2-271afc29b623 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:36:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:36:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:36:05 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:36:05 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:36:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:36:05 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:36:05 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:36:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-07c4c8e4-e08e-4044-bad2-271afc29b623 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:05 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=15, name=volume-07c4c8e4-e08e-4044-bad2-271afc29b623, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:36:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-07c4c8e4-e08e-4044-bad2-271afc29b623 1073741824" returned: 0 in 1.212s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-07c4c8e4-e08e-4044-bad2-271afc29b623 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-07c4c8e4-e08e-4044-bad2-271afc29b623" returned: 0 in 0.216s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:06 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] <== create_volume: return (1572ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:36:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:36:07 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e011c0b-24c8-4bde-903c-cad4b0cda084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07c4c8e4-e08e-4044-bad2-271afc29b623', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:07 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8beeed3-aae0-4293-8b01-bfe43c44b434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:07 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Volume volume-07c4c8e4-e08e-4044-bad2-271afc29b623 (07c4c8e4-e08e-4044-bad2-271afc29b623): created successfully
Sep 10 11:36:07 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8beeed3-aae0-4293-8b01-bfe43c44b434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:07 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Flow 'volume_create_manager' (b156b10b-9c30-4ff2-be31-317e9a9d39f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:36:07 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-bab13862-748c-4109-84b9-0c290527eeeb tempest-VolumesTestJSON-642842873 None] Created volume successfully.
Sep 10 11:36:09 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:36:09 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:36:09 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Flow 'volume_create_manager' (322de0bf-341e-49a6-afcc-067477b156d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:36:09 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b938a32d-7def-4e66-a90d-2f9bbd5a0899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:09 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b938a32d-7def-4e66-a90d-2f9bbd5a0899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1913474031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed24ad4-5722-46e6-aabb-f33f39086178,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='011c0e4e5ed94726ae686dd8f5acb99b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:36:09Z,use_quota=True,user_id='69fa47f38efa4823877f4342d9967209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:09 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c9b9e08-fa0e-40f5-a487-616c7694f71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:09 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c9b9e08-fa0e-40f5-a487-616c7694f71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:09 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df466f8-c2f2-43d3-84e0-98226ca296ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:09 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df466f8-c2f2-43d3-84e0-98226ca296ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ed24ad4-5722-46e6-aabb-f33f39086178', 'volume_name': 'volume-4ed24ad4-5722-46e6-aabb-f33f39086178', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:09 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a13047a3-a3ed-401a-914b-d4dca7b82d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:09 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a13047a3-a3ed-401a-914b-d4dca7b82d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:09 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e36163a7-9c99-4fdf-b4dd-ccc60bae91a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:09 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Volume 4ed24ad4-5722-46e6-aabb-f33f39086178: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ed24ad4-5722-46e6-aabb-f33f39086178', 'volume_size': 1}
Sep 10 11:36:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:36:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:36:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1913474031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed24ad4-5722-46e6-aabb-f33f39086178,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='011c0e4e5ed94726ae686dd8f5acb99b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:36:09Z,use_quota=True,user_id='69fa47f38efa4823877f4342d9967209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:36:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Creating volume 4ed24ad4-5722-46e6-aabb-f33f39086178 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:36:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:36:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:36:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:36:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:36:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:36:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:36:09 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:36:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4ed24ad4-5722-46e6-aabb-f33f39086178 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:10 devstack quobyte-client[82616]: System call of process 88945 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:36:10 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=16, name=volume-4ed24ad4-5722-46e6-aabb-f33f39086178, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:36:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4ed24ad4-5722-46e6-aabb-f33f39086178 1073741824" returned: 0 in 0.688s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4ed24ad4-5722-46e6-aabb-f33f39086178 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4ed24ad4-5722-46e6-aabb-f33f39086178" returned: 0 in 0.162s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:10 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] <== create_volume: return (975ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:36:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:36:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e36163a7-9c99-4fdf-b4dd-ccc60bae91a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ed24ad4-5722-46e6-aabb-f33f39086178', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (609522f2-5902-47d4-8563-e28fc5501079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:11 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Volume volume-4ed24ad4-5722-46e6-aabb-f33f39086178 (4ed24ad4-5722-46e6-aabb-f33f39086178): created successfully
Sep 10 11:36:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (609522f2-5902-47d4-8563-e28fc5501079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Flow 'volume_create_manager' (322de0bf-341e-49a6-afcc-067477b156d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:36:11 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-d6e63353-8e96-4120-a7c5-849108533c2f tempest-VolumesTestJSON-642842873 None] Created volume successfully.
Sep 10 11:36:13 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b3bbb968-d27a-4012-a101-1d9dd917fbfb tempest-VolumesTestJSON-642842873 None] Acquiring lock "cinder-4ed24ad4-5722-46e6-aabb-f33f39086178-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:36:13 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b3bbb968-d27a-4012-a101-1d9dd917fbfb tempest-VolumesTestJSON-642842873 None] Lock "cinder-4ed24ad4-5722-46e6-aabb-f33f39086178-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:36:13 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-b3bbb968-d27a-4012-a101-1d9dd917fbfb tempest-VolumesTestJSON-642842873 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:36:13 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b3bbb968-d27a-4012-a101-1d9dd917fbfb tempest-VolumesTestJSON-642842873 None] Acquiring lock "cinder-quobyte-4ed24ad4-5722-46e6-aabb-f33f39086178" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:36:13 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b3bbb968-d27a-4012-a101-1d9dd917fbfb tempest-VolumesTestJSON-642842873 None] Lock "cinder-quobyte-4ed24ad4-5722-46e6-aabb-f33f39086178" acquired by "delete_volume" :: waited 0.018s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:36:13 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf06a8d-f77f-4960-9af3-226973436ffb]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:36:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b3bbb968-d27a-4012-a101-1d9dd917fbfb tempest-VolumesTestJSON-642842873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4ed24ad4-5722-46e6-aabb-f33f39086178 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b3bbb968-d27a-4012-a101-1d9dd917fbfb tempest-VolumesTestJSON-642842873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4ed24ad4-5722-46e6-aabb-f33f39086178" returned: 0 in 0.664s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b3bbb968-d27a-4012-a101-1d9dd917fbfb tempest-VolumesTestJSON-642842873 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4ed24ad4-5722-46e6-aabb-f33f39086178 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b3bbb968-d27a-4012-a101-1d9dd917fbfb tempest-VolumesTestJSON-642842873 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4ed24ad4-5722-46e6-aabb-f33f39086178" returned: 0 in 0.178s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:14 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b3bbb968-d27a-4012-a101-1d9dd917fbfb tempest-VolumesTestJSON-642842873 None] Lock "cinder-quobyte-4ed24ad4-5722-46e6-aabb-f33f39086178" released by "delete_volume" :: held 1.170s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:36:15 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-b3bbb968-d27a-4012-a101-1d9dd917fbfb tempest-VolumesTestJSON-642842873 None] Created reservations ['856d8a42-ee1d-4918-94d0-238ae064262f', '372271a8-248e-41ef-9a39-805ed09e1f55', '7e540733-e468-44be-a7b9-d3e3db2f2a36', '7c48ba7e-f990-47e1-8adb-47c2371cf36f'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:36:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b3bbb968-d27a-4012-a101-1d9dd917fbfb tempest-VolumesTestJSON-642842873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:36:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b3bbb968-d27a-4012-a101-1d9dd917fbfb tempest-VolumesTestJSON-642842873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:36:15 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b3bbb968-d27a-4012-a101-1d9dd917fbfb tempest-VolumesTestJSON-642842873 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:36:15 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b3bbb968-d27a-4012-a101-1d9dd917fbfb tempest-VolumesTestJSON-642842873 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:36:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b3bbb968-d27a-4012-a101-1d9dd917fbfb tempest-VolumesTestJSON-642842873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:36:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b3bbb968-d27a-4012-a101-1d9dd917fbfb tempest-VolumesTestJSON-642842873 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b3bbb968-d27a-4012-a101-1d9dd917fbfb tempest-VolumesTestJSON-642842873 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.108s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:15 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-b3bbb968-d27a-4012-a101-1d9dd917fbfb tempest-VolumesTestJSON-642842873 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:36:15 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-b3bbb968-d27a-4012-a101-1d9dd917fbfb tempest-VolumesTestJSON-642842873 None] Deleted volume successfully.
Sep 10 11:36:15 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b3bbb968-d27a-4012-a101-1d9dd917fbfb tempest-VolumesTestJSON-642842873 None] Lock "cinder-4ed24ad4-5722-46e6-aabb-f33f39086178-delete_volume" released by "delete_volume" :: held 2.395s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:36:15 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-792ba893-1fc8-4338-80b7-20295a567c5b tempest-VolumesTestJSON-642842873 None] Acquiring lock "cinder-07c4c8e4-e08e-4044-bad2-271afc29b623-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:36:15 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-792ba893-1fc8-4338-80b7-20295a567c5b tempest-VolumesTestJSON-642842873 None] Lock "cinder-07c4c8e4-e08e-4044-bad2-271afc29b623-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:36:16 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-792ba893-1fc8-4338-80b7-20295a567c5b tempest-VolumesTestJSON-642842873 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:36:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-792ba893-1fc8-4338-80b7-20295a567c5b tempest-VolumesTestJSON-642842873 None] Acquiring lock "cinder-quobyte-07c4c8e4-e08e-4044-bad2-271afc29b623" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:36:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-792ba893-1fc8-4338-80b7-20295a567c5b tempest-VolumesTestJSON-642842873 None] Lock "cinder-quobyte-07c4c8e4-e08e-4044-bad2-271afc29b623" acquired by "delete_volume" :: waited 0.011s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:36:16 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06c379c-eebd-42aa-a141-4f3cff2d5735]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:36:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-792ba893-1fc8-4338-80b7-20295a567c5b tempest-VolumesTestJSON-642842873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-07c4c8e4-e08e-4044-bad2-271afc29b623 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-792ba893-1fc8-4338-80b7-20295a567c5b tempest-VolumesTestJSON-642842873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-07c4c8e4-e08e-4044-bad2-271afc29b623" returned: 0 in 0.494s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-792ba893-1fc8-4338-80b7-20295a567c5b tempest-VolumesTestJSON-642842873 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-07c4c8e4-e08e-4044-bad2-271afc29b623 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-792ba893-1fc8-4338-80b7-20295a567c5b tempest-VolumesTestJSON-642842873 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-07c4c8e4-e08e-4044-bad2-271afc29b623" returned: 0 in 0.118s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:17 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-792ba893-1fc8-4338-80b7-20295a567c5b tempest-VolumesTestJSON-642842873 None] Lock "cinder-quobyte-07c4c8e4-e08e-4044-bad2-271afc29b623" released by "delete_volume" :: held 0.792s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:36:17 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-792ba893-1fc8-4338-80b7-20295a567c5b tempest-VolumesTestJSON-642842873 None] Created reservations ['d3be8aa0-00f7-45df-b609-09183e74b239', '9ff8bb7e-4c35-4365-b1a3-64581a31f4b2', 'be26c208-e09f-4f20-a690-4aec65291faa', 'aa547c98-8e39-4ee2-8d7c-fd0a0e0a79d9'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:36:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-792ba893-1fc8-4338-80b7-20295a567c5b tempest-VolumesTestJSON-642842873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:36:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-792ba893-1fc8-4338-80b7-20295a567c5b tempest-VolumesTestJSON-642842873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:36:17 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-792ba893-1fc8-4338-80b7-20295a567c5b tempest-VolumesTestJSON-642842873 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:36:17 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-792ba893-1fc8-4338-80b7-20295a567c5b tempest-VolumesTestJSON-642842873 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:36:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-792ba893-1fc8-4338-80b7-20295a567c5b tempest-VolumesTestJSON-642842873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:36:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-792ba893-1fc8-4338-80b7-20295a567c5b tempest-VolumesTestJSON-642842873 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-792ba893-1fc8-4338-80b7-20295a567c5b tempest-VolumesTestJSON-642842873 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.114s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:17 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-792ba893-1fc8-4338-80b7-20295a567c5b tempest-VolumesTestJSON-642842873 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:36:17 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-792ba893-1fc8-4338-80b7-20295a567c5b tempest-VolumesTestJSON-642842873 None] Deleted volume successfully.
Sep 10 11:36:17 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-792ba893-1fc8-4338-80b7-20295a567c5b tempest-VolumesTestJSON-642842873 None] Lock "cinder-07c4c8e4-e08e-4044-bad2-271afc29b623-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:36:18 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-96ebcbd8-8ca5-4602-b27a-0a7b5ae0681a tempest-VolumesTestJSON-642842873 None] Acquiring lock "cinder-5d9db038-98c7-40fa-8bdc-04407d86ac23-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:36:18 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-96ebcbd8-8ca5-4602-b27a-0a7b5ae0681a tempest-VolumesTestJSON-642842873 None] Lock "cinder-5d9db038-98c7-40fa-8bdc-04407d86ac23-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:36:18 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-96ebcbd8-8ca5-4602-b27a-0a7b5ae0681a tempest-VolumesTestJSON-642842873 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:36:18 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-96ebcbd8-8ca5-4602-b27a-0a7b5ae0681a tempest-VolumesTestJSON-642842873 None] Acquiring lock "cinder-quobyte-5d9db038-98c7-40fa-8bdc-04407d86ac23" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:36:18 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-96ebcbd8-8ca5-4602-b27a-0a7b5ae0681a tempest-VolumesTestJSON-642842873 None] Lock "cinder-quobyte-5d9db038-98c7-40fa-8bdc-04407d86ac23" acquired by "delete_volume" :: waited 0.023s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:36:18 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1754cee-2ef8-4e9f-9b17-68c7c1d295ff]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:36:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-96ebcbd8-8ca5-4602-b27a-0a7b5ae0681a tempest-VolumesTestJSON-642842873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5d9db038-98c7-40fa-8bdc-04407d86ac23 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-96ebcbd8-8ca5-4602-b27a-0a7b5ae0681a tempest-VolumesTestJSON-642842873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5d9db038-98c7-40fa-8bdc-04407d86ac23" returned: 0 in 0.720s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-96ebcbd8-8ca5-4602-b27a-0a7b5ae0681a tempest-VolumesTestJSON-642842873 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5d9db038-98c7-40fa-8bdc-04407d86ac23 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-96ebcbd8-8ca5-4602-b27a-0a7b5ae0681a tempest-VolumesTestJSON-642842873 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5d9db038-98c7-40fa-8bdc-04407d86ac23" returned: 0 in 0.150s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:19 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-96ebcbd8-8ca5-4602-b27a-0a7b5ae0681a tempest-VolumesTestJSON-642842873 None] Lock "cinder-quobyte-5d9db038-98c7-40fa-8bdc-04407d86ac23" released by "delete_volume" :: held 1.122s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:36:20 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-96ebcbd8-8ca5-4602-b27a-0a7b5ae0681a tempest-VolumesTestJSON-642842873 None] Created reservations ['726e345a-7aa1-4872-b0d0-936b21b4d1cc', '0e567634-8b5e-4418-a2dd-dba93494b90a', '628ada79-3210-4824-a85d-f5fd4e8fb10e', 'fc5bd38c-0009-4870-ac73-2d7aefd221fa'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:36:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-96ebcbd8-8ca5-4602-b27a-0a7b5ae0681a tempest-VolumesTestJSON-642842873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:36:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-96ebcbd8-8ca5-4602-b27a-0a7b5ae0681a tempest-VolumesTestJSON-642842873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:36:20 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-96ebcbd8-8ca5-4602-b27a-0a7b5ae0681a tempest-VolumesTestJSON-642842873 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:36:20 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-96ebcbd8-8ca5-4602-b27a-0a7b5ae0681a tempest-VolumesTestJSON-642842873 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:36:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-96ebcbd8-8ca5-4602-b27a-0a7b5ae0681a tempest-VolumesTestJSON-642842873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:36:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-96ebcbd8-8ca5-4602-b27a-0a7b5ae0681a tempest-VolumesTestJSON-642842873 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-96ebcbd8-8ca5-4602-b27a-0a7b5ae0681a tempest-VolumesTestJSON-642842873 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.253s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:20 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-96ebcbd8-8ca5-4602-b27a-0a7b5ae0681a tempest-VolumesTestJSON-642842873 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:36:21 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-96ebcbd8-8ca5-4602-b27a-0a7b5ae0681a tempest-VolumesTestJSON-642842873 None] Deleted volume successfully.
Sep 10 11:36:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:36:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:36:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:36:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:36:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:36:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:36:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:23 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-96ebcbd8-8ca5-4602-b27a-0a7b5ae0681a tempest-VolumesTestJSON-642842873 None] Lock "cinder-5d9db038-98c7-40fa-8bdc-04407d86ac23-delete_volume" released by "delete_volume" :: held 4.462s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:36:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 1.024s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:23 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:36:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6c75da22-8855-44b3-95e4-3bcefb5cf3ab tempest-BackendsCapabilitiesAdminTestsJSON-768247247 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.914478302002, 'free_capacity_gb': 924.914478302002, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82594) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 10 11:36:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-042db15f-1221-4937-b62d-d53431c6175f tempest-BackendsCapabilitiesAdminTestsJSON-768247247 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.914478302002, 'free_capacity_gb': 924.914478302002, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82594) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 10 11:36:30 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=32,cinder:SELECT=16,cinder:DELETE=3 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:36:31 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=21,cinder:UPDATE=29,cinder:DELETE=3,cinder:INSERT=12 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:36:35 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-78e15bcf-1b59-497f-a2d0-76976478f558 tempest-GroupSnapshotsV319Test-76420040 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:36:35 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-78e15bcf-1b59-497f-a2d0-76976478f558 tempest-GroupSnapshotsV319Test-76420040 None] Group tempest-GroupSnapshotsV319Test-Group-1351023419: creating
Sep 10 11:36:35 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-78e15bcf-1b59-497f-a2d0-76976478f558 tempest-GroupSnapshotsV319Test-76420040 None] Group tempest-GroupSnapshotsV319Test-Group-1351023419: created successfully
Sep 10 11:36:35 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-78e15bcf-1b59-497f-a2d0-76976478f558 tempest-GroupSnapshotsV319Test-76420040 None] Create group completed successfully.
Sep 10 11:36:37 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:36:37 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:36:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Flow 'volume_create_manager' (9dbed9e0-6c29-42d4-84b5-f2132bd5a67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:36:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec62f7b-b284-4cc9-8619-fe5147326297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec62f7b-b284-4cc9-8619-fe5147326297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-512415561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=67d255f8-f9ec-474d-8434-89f12463c3af,host='devstack@QuobyteHD#QuobyteHD',id=238cf612-e07e-4601-8c67-4b9a58b7299f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac73680f74694b998b4d95b9b8ffb232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:36:37Z,use_quota=True,user_id='c587fa5abc11412aa85d5149eb60523e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cfa3922-784e-438d-80c2-cdf5f193dd68),volume_type_id=0cfa3922-784e-438d-80c2-cdf5f193dd68)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253b0a2a-1cb8-48b1-8069-5ea799aa5032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253b0a2a-1cb8-48b1-8069-5ea799aa5032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1718ebd0-419c-4b03-ba06-5d6fc7ec4172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1718ebd0-419c-4b03-ba06-5d6fc7ec4172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '238cf612-e07e-4601-8c67-4b9a58b7299f', 'volume_name': 'volume-238cf612-e07e-4601-8c67-4b9a58b7299f', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ad0ba9-18ef-4e90-8700-d8b84db64a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ad0ba9-18ef-4e90-8700-d8b84db64a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f39a3dc1-f42d-4117-9c7f-1bb255ff90fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:37 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Volume 238cf612-e07e-4601-8c67-4b9a58b7299f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-238cf612-e07e-4601-8c67-4b9a58b7299f', 'volume_size': 1}
Sep 10 11:36:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:36:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:36:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=67d255f8-f9ec-474d-8434-89f12463c3af,created_at=2025-09-10T09:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-512415561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=67d255f8-f9ec-474d-8434-89f12463c3af,host='devstack@QuobyteHD#QuobyteHD',id=238cf612-e07e-4601-8c67-4b9a58b7299f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac73680f74694b998b4d95b9b8ffb232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:36:37Z,use_quota=True,user_id='c587fa5abc11412aa85d5149eb60523e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cfa3922-784e-438d-80c2-cdf5f193dd68),volume_type_id=0cfa3922-784e-438d-80c2-cdf5f193dd68)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:36:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Creating volume 238cf612-e07e-4601-8c67-4b9a58b7299f {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:36:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:36:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:36:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:36:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:36:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:36:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:36:37 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:36:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:37 devstack quobyte-client[82616]: System call of process 89056 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:36:37 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=17, name=volume-238cf612-e07e-4601-8c67-4b9a58b7299f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:36:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f 1073741824" returned: 0 in 0.562s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f" returned: 0 in 0.100s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:38 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] <== create_volume: return (783ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:36:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:36:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f39a3dc1-f42d-4117-9c7f-1bb255ff90fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-238cf612-e07e-4601-8c67-4b9a58b7299f', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2473107-3c82-41ea-a897-8caaa2468a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:38 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Volume volume-238cf612-e07e-4601-8c67-4b9a58b7299f (238cf612-e07e-4601-8c67-4b9a58b7299f): created successfully
Sep 10 11:36:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2473107-3c82-41ea-a897-8caaa2468a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Flow 'volume_create_manager' (9dbed9e0-6c29-42d4-84b5-f2132bd5a67e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:36:38 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-6821ba9b-b74d-447e-b54d-4ddc90da9521 tempest-GroupSnapshotsV319Test-76420040 None] Created volume successfully.
Sep 10 11:36:40 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-6696322f-75f8-4589-a031-3a8e5dc696cc tempest-GroupSnapshotsV319Test-76420040 None] GroupSnapshot 66a93c23-4116-4174-9c7e-e12d049d3227: creating.
Sep 10 11:36:40 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-6696322f-75f8-4589-a031-3a8e5dc696cc tempest-GroupSnapshotsV319Test-76420040 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:36:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6696322f-75f8-4589-a031-3a8e5dc696cc tempest-GroupSnapshotsV319Test-76420040 None] Group snapshot 66a93c23-4116-4174-9c7e-e12d049d3227: creating. {{(pid=82594) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 10 11:36:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6696322f-75f8-4589-a031-3a8e5dc696cc tempest-GroupSnapshotsV319Test-76420040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:36:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6696322f-75f8-4589-a031-3a8e5dc696cc tempest-GroupSnapshotsV319Test-76420040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:36:40 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-6696322f-75f8-4589-a031-3a8e5dc696cc tempest-GroupSnapshotsV319Test-76420040 None] Creating offline snapshot 32b03ec4-4fa7-4fbb-938b-3994e1161a17 of volume 238cf612-e07e-4601-8c67-4b9a58b7299f {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 11:36:40 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[59aec502-adac-4e12-8580-561eb13c2177]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:36:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6696322f-75f8-4589-a031-3a8e5dc696cc tempest-GroupSnapshotsV319Test-76420040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6696322f-75f8-4589-a031-3a8e5dc696cc tempest-GroupSnapshotsV319Test-76420040 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f" returned: 0 in 0.597s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6696322f-75f8-4589-a031-3a8e5dc696cc tempest-GroupSnapshotsV319Test-76420040 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f.32b03ec4-4fa7-4fbb-938b-3994e1161a17 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:41 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=18, name=volume-238cf612-e07e-4601-8c67-4b9a58b7299f.32b03ec4-4fa7-4fbb-938b-3994e1161a17, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:36:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6696322f-75f8-4589-a031-3a8e5dc696cc tempest-GroupSnapshotsV319Test-76420040 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f.32b03ec4-4fa7-4fbb-938b-3994e1161a17 1G" returned: 0 in 0.299s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6696322f-75f8-4589-a031-3a8e5dc696cc tempest-GroupSnapshotsV319Test-76420040 None] Running cmd (subprocess): qemu-img rebase -u -b volume-238cf612-e07e-4601-8c67-4b9a58b7299f -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f.32b03ec4-4fa7-4fbb-938b-3994e1161a17 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6696322f-75f8-4589-a031-3a8e5dc696cc tempest-GroupSnapshotsV319Test-76420040 None] CMD "qemu-img rebase -u -b volume-238cf612-e07e-4601-8c67-4b9a58b7299f -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f.32b03ec4-4fa7-4fbb-938b-3994e1161a17" returned: 0 in 0.231s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-6696322f-75f8-4589-a031-3a8e5dc696cc tempest-GroupSnapshotsV319Test-76420040 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f.32b03ec4-4fa7-4fbb-938b-3994e1161a17 is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:36:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6696322f-75f8-4589-a031-3a8e5dc696cc tempest-GroupSnapshotsV319Test-76420040 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f.32b03ec4-4fa7-4fbb-938b-3994e1161a17 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6696322f-75f8-4589-a031-3a8e5dc696cc tempest-GroupSnapshotsV319Test-76420040 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f.32b03ec4-4fa7-4fbb-938b-3994e1161a17" returned: 0 in 0.125s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-6696322f-75f8-4589-a031-3a8e5dc696cc tempest-GroupSnapshotsV319Test-76420040 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 11:36:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6696322f-75f8-4589-a031-3a8e5dc696cc tempest-GroupSnapshotsV319Test-76420040 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f.32b03ec4-4fa7-4fbb-938b-3994e1161a17 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6696322f-75f8-4589-a031-3a8e5dc696cc tempest-GroupSnapshotsV319Test-76420040 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f.32b03ec4-4fa7-4fbb-938b-3994e1161a17" returned: 0 in 0.107s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6696322f-75f8-4589-a031-3a8e5dc696cc tempest-GroupSnapshotsV319Test-76420040 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6696322f-75f8-4589-a031-3a8e5dc696cc tempest-GroupSnapshotsV319Test-76420040 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f.info" returned: 0 in 0.122s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:42 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-6696322f-75f8-4589-a031-3a8e5dc696cc tempest-GroupSnapshotsV319Test-76420040 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f.info is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:36:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6696322f-75f8-4589-a031-3a8e5dc696cc tempest-GroupSnapshotsV319Test-76420040 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6696322f-75f8-4589-a031-3a8e5dc696cc tempest-GroupSnapshotsV319Test-76420040 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f.info" returned: 0 in 0.153s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6696322f-75f8-4589-a031-3a8e5dc696cc tempest-GroupSnapshotsV319Test-76420040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.986s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:36:42 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-6696322f-75f8-4589-a031-3a8e5dc696cc tempest-GroupSnapshotsV319Test-76420040 None] group_snapshot 66a93c23-4116-4174-9c7e-e12d049d3227: created successfully
Sep 10 11:36:44 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-9a6726a4-cbbb-4e44-8cff-46d28a5fd139 tempest-GroupSnapshotsV319Test-76420040 None] group_snapshot 66a93c23-4116-4174-9c7e-e12d049d3227: deleting
Sep 10 11:36:44 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-9a6726a4-cbbb-4e44-8cff-46d28a5fd139 tempest-GroupSnapshotsV319Test-76420040 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:36:44 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9a6726a4-cbbb-4e44-8cff-46d28a5fd139 tempest-GroupSnapshotsV319Test-76420040 None] group_snapshot 66a93c23-4116-4174-9c7e-e12d049d3227: deleting {{(pid=82594) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 10 11:36:44 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9a6726a4-cbbb-4e44-8cff-46d28a5fd139 tempest-GroupSnapshotsV319Test-76420040 None] Acquiring lock "cinder-quobyte-238cf612-e07e-4601-8c67-4b9a58b7299f" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:36:44 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9a6726a4-cbbb-4e44-8cff-46d28a5fd139 tempest-GroupSnapshotsV319Test-76420040 None] Lock "cinder-quobyte-238cf612-e07e-4601-8c67-4b9a58b7299f" acquired by "delete_snapshot" :: waited 0.066s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:36:44 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9a6726a4-cbbb-4e44-8cff-46d28a5fd139 tempest-GroupSnapshotsV319Test-76420040 None] Acquiring lock "cinder-quobyte-32b03ec4-4fa7-4fbb-938b-3994e1161a17" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:36:44 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9a6726a4-cbbb-4e44-8cff-46d28a5fd139 tempest-GroupSnapshotsV319Test-76420040 None] Lock "cinder-quobyte-32b03ec4-4fa7-4fbb-938b-3994e1161a17" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:36:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-9a6726a4-cbbb-4e44-8cff-46d28a5fd139 tempest-GroupSnapshotsV319Test-76420040 None] Deleting offline snapshot 32b03ec4-4fa7-4fbb-938b-3994e1161a17 of volume 238cf612-e07e-4601-8c67-4b9a58b7299f {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 11:36:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-9a6726a4-cbbb-4e44-8cff-46d28a5fd139 tempest-GroupSnapshotsV319Test-76420040 None] snapshot_file for this snap is: volume-238cf612-e07e-4601-8c67-4b9a58b7299f.32b03ec4-4fa7-4fbb-938b-3994e1161a17 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 11:36:44 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fbddc1-f3f0-4b3b-8354-c5667f660f89]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:36:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9a6726a4-cbbb-4e44-8cff-46d28a5fd139 tempest-GroupSnapshotsV319Test-76420040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f.32b03ec4-4fa7-4fbb-938b-3994e1161a17 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:44 devstack quobyte-client[82616]: System call of process 89082 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:36:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9a6726a4-cbbb-4e44-8cff-46d28a5fd139 tempest-GroupSnapshotsV319Test-76420040 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f.32b03ec4-4fa7-4fbb-938b-3994e1161a17" returned: 0 in 0.436s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-9a6726a4-cbbb-4e44-8cff-46d28a5fd139 tempest-GroupSnapshotsV319Test-76420040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-238cf612-e07e-4601-8c67-4b9a58b7299f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:36:44 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0b9f0b-ec5c-4eae-8013-2c4bc0489be6]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:36:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9a6726a4-cbbb-4e44-8cff-46d28a5fd139 tempest-GroupSnapshotsV319Test-76420040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9a6726a4-cbbb-4e44-8cff-46d28a5fd139 tempest-GroupSnapshotsV319Test-76420040 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f" returned: 0 in 0.391s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9a6726a4-cbbb-4e44-8cff-46d28a5fd139 tempest-GroupSnapshotsV319Test-76420040 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f.32b03ec4-4fa7-4fbb-938b-3994e1161a17 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9a6726a4-cbbb-4e44-8cff-46d28a5fd139 tempest-GroupSnapshotsV319Test-76420040 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f.32b03ec4-4fa7-4fbb-938b-3994e1161a17" returned: 0 in 0.252s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9a6726a4-cbbb-4e44-8cff-46d28a5fd139 tempest-GroupSnapshotsV319Test-76420040 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f.32b03ec4-4fa7-4fbb-938b-3994e1161a17 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9a6726a4-cbbb-4e44-8cff-46d28a5fd139 tempest-GroupSnapshotsV319Test-76420040 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f.32b03ec4-4fa7-4fbb-938b-3994e1161a17" returned: 0 in 0.088s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:45 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9a6726a4-cbbb-4e44-8cff-46d28a5fd139 tempest-GroupSnapshotsV319Test-76420040 None] Lock "cinder-quobyte-32b03ec4-4fa7-4fbb-938b-3994e1161a17" released by "_delete_snapshot" :: held 1.534s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:36:45 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9a6726a4-cbbb-4e44-8cff-46d28a5fd139 tempest-GroupSnapshotsV319Test-76420040 None] Lock "cinder-quobyte-238cf612-e07e-4601-8c67-4b9a58b7299f" released by "delete_snapshot" :: held 1.566s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:36:46 devstack cinder-volume[82594]: WARNING cinder.quota [None req-9a6726a4-cbbb-4e44-8cff-46d28a5fd139 tempest-GroupSnapshotsV319Test-76420040 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1563625305 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1563625305, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:36:46 devstack cinder-volume[82594]: WARNING cinder.quota [None req-9a6726a4-cbbb-4e44-8cff-46d28a5fd139 tempest-GroupSnapshotsV319Test-76420040 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1563625305 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1563625305, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:36:46 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-9a6726a4-cbbb-4e44-8cff-46d28a5fd139 tempest-GroupSnapshotsV319Test-76420040 None] Created reservations ['4aa79849-a335-4a6a-8ec4-26325fb006d7', 'ecb4819e-6b8c-4843-bcdb-9c5ed1e0a4ad', '4f8400c4-2a8b-4faa-8029-87fc8e95389f', '045b4ca6-ed12-4d71-b5d2-662d205238dc'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:36:46 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-9a6726a4-cbbb-4e44-8cff-46d28a5fd139 tempest-GroupSnapshotsV319Test-76420040 None] group_snapshot 66a93c23-4116-4174-9c7e-e12d049d3227: deleted successfully
Sep 10 11:36:47 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-2fef2b92-92a2-430c-8532-86687f50dc79 tempest-GroupSnapshotsV319Test-76420040 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:36:47 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2fef2b92-92a2-430c-8532-86687f50dc79 tempest-GroupSnapshotsV319Test-76420040 None] Acquiring lock "cinder-quobyte-238cf612-e07e-4601-8c67-4b9a58b7299f" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:36:47 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2fef2b92-92a2-430c-8532-86687f50dc79 tempest-GroupSnapshotsV319Test-76420040 None] Lock "cinder-quobyte-238cf612-e07e-4601-8c67-4b9a58b7299f" acquired by "delete_volume" :: waited 0.029s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:36:47 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb5326e-0a5b-4d43-8b92-06f480f1de5b]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:36:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2fef2b92-92a2-430c-8532-86687f50dc79 tempest-GroupSnapshotsV319Test-76420040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2fef2b92-92a2-430c-8532-86687f50dc79 tempest-GroupSnapshotsV319Test-76420040 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f" returned: 0 in 0.538s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2fef2b92-92a2-430c-8532-86687f50dc79 tempest-GroupSnapshotsV319Test-76420040 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2fef2b92-92a2-430c-8532-86687f50dc79 tempest-GroupSnapshotsV319Test-76420040 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-238cf612-e07e-4601-8c67-4b9a58b7299f" returned: 0 in 0.085s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:48 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2fef2b92-92a2-430c-8532-86687f50dc79 tempest-GroupSnapshotsV319Test-76420040 None] Lock "cinder-quobyte-238cf612-e07e-4601-8c67-4b9a58b7299f" released by "delete_volume" :: held 0.790s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:36:48 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-2fef2b92-92a2-430c-8532-86687f50dc79 tempest-GroupSnapshotsV319Test-76420040 None] Created reservations ['fece5334-39fd-4103-b8c6-3c635fac1d00'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:36:48 devstack cinder-volume[82594]: WARNING cinder.quota [None req-2fef2b92-92a2-430c-8532-86687f50dc79 tempest-GroupSnapshotsV319Test-76420040 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1563625305 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1563625305, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:36:48 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-2fef2b92-92a2-430c-8532-86687f50dc79 tempest-GroupSnapshotsV319Test-76420040 None] Created reservations ['a00000c6-6683-4efd-9c3c-a2fc979e457b', '7b9f3e65-ab4c-47ff-904c-16568d647df7', 'ba8f7e31-c541-4a6a-9e55-884e9cc66379', 'e8630116-d97a-4b80-98cf-a9ceae88a463'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:36:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2fef2b92-92a2-430c-8532-86687f50dc79 tempest-GroupSnapshotsV319Test-76420040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:36:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2fef2b92-92a2-430c-8532-86687f50dc79 tempest-GroupSnapshotsV319Test-76420040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:36:48 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2fef2b92-92a2-430c-8532-86687f50dc79 tempest-GroupSnapshotsV319Test-76420040 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:36:48 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2fef2b92-92a2-430c-8532-86687f50dc79 tempest-GroupSnapshotsV319Test-76420040 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:36:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2fef2b92-92a2-430c-8532-86687f50dc79 tempest-GroupSnapshotsV319Test-76420040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:36:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2fef2b92-92a2-430c-8532-86687f50dc79 tempest-GroupSnapshotsV319Test-76420040 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2fef2b92-92a2-430c-8532-86687f50dc79 tempest-GroupSnapshotsV319Test-76420040 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.093s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:49 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-2fef2b92-92a2-430c-8532-86687f50dc79 tempest-GroupSnapshotsV319Test-76420040 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:36:49 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-2fef2b92-92a2-430c-8532-86687f50dc79 tempest-GroupSnapshotsV319Test-76420040 None] Delete group completed successfully.
Sep 10 11:36:51 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:36:51 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:36:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Flow 'volume_create_manager' (9e1da33f-d0b2-4915-9a44-7bb2e5bca23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:36:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bfa244f-b3ff-4db5-937b-41e1d01d7eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bfa244f-b3ff-4db5-937b-41e1d01d7eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-783064894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9987f31f8dd1465788a0c09d25fd87b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:36:51Z,use_quota=True,user_id='8d853555090c49368e7a0247b82a3a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b02f0b-6392-4612-9651-0b1a220991dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b02f0b-6392-4612-9651-0b1a220991dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24e415b9-c7e2-4ae3-855d-2e3997025f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24e415b9-c7e2-4ae3-855d-2e3997025f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08', 'volume_name': 'volume-e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (789d38f2-0c53-422b-bbb1-3718d747da48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (789d38f2-0c53-422b-bbb1-3718d747da48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd553c2-1d6a-412a-86db-3047166acd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:51 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Volume e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08', 'volume_size': 1}
Sep 10 11:36:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:36:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:36:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-783064894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9987f31f8dd1465788a0c09d25fd87b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:36:51Z,use_quota=True,user_id='8d853555090c49368e7a0247b82a3a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:36:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Creating volume e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:36:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:36:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:36:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:36:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:36:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:36:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:36:51 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:36:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:51 devstack quobyte-client[82616]: System call of process 89100 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:36:52 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=20, name=volume-e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:36:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08 1073741824" returned: 0 in 0.729s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08" returned: 0 in 0.161s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:52 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] <== create_volume: return (968ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:36:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:36:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd553c2-1d6a-412a-86db-3047166acd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d7f1790-88a2-4631-a1c8-5fc93f22b3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:36:53 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Volume volume-e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08 (e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08): created successfully
Sep 10 11:36:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d7f1790-88a2-4631-a1c8-5fc93f22b3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:36:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Flow 'volume_create_manager' (9e1da33f-d0b2-4915-9a44-7bb2e5bca23b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:36:53 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-f68ef769-b58f-460b-9913-56b09ec0f5c8 tempest-AttachVolumeTestJSON-901448073 None] Created volume successfully.
Sep 10 11:36:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-64eef95e-d3fa-495b-9fd3-e31e883b82e9 req-140efaa3-c1df-44be-a06a-e111fc9d9956 tempest-AttachVolumeTestJSON-901448073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:36:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-64eef95e-d3fa-495b-9fd3-e31e883b82e9 req-140efaa3-c1df-44be-a06a-e111fc9d9956 tempest-AttachVolumeTestJSON-901448073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:36:58 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1cd3e4-5754-461e-affc-036955fafa8f]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:36:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-64eef95e-d3fa-495b-9fd3-e31e883b82e9 req-140efaa3-c1df-44be-a06a-e111fc9d9956 tempest-AttachVolumeTestJSON-901448073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:36:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-64eef95e-d3fa-495b-9fd3-e31e883b82e9 req-140efaa3-c1df-44be-a06a-e111fc9d9956 tempest-AttachVolumeTestJSON-901448073 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08" returned: 0 in 0.616s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:36:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-64eef95e-d3fa-495b-9fd3-e31e883b82e9 req-140efaa3-c1df-44be-a06a-e111fc9d9956 tempest-AttachVolumeTestJSON-901448073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.715s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:36:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-64eef95e-d3fa-495b-9fd3-e31e883b82e9 req-140efaa3-c1df-44be-a06a-e111fc9d9956 tempest-AttachVolumeTestJSON-901448073 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56', 'name': 'volume-e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb123b75-1586-4daa-aa8d-de680305c266', 'enforce_multipath': True} {{(pid=82594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 11:36:59 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-64eef95e-d3fa-495b-9fd3-e31e883b82e9 req-140efaa3-c1df-44be-a06a-e111fc9d9956 tempest-AttachVolumeTestJSON-901448073 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:36:59 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-64eef95e-d3fa-495b-9fd3-e31e883b82e9 req-140efaa3-c1df-44be-a06a-e111fc9d9956 tempest-AttachVolumeTestJSON-901448073 None] attachment_update completed successfully.
Sep 10 11:37:00 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Flow 'volume_create_manager' (c2ee6f8b-dc0d-4116-960b-8017d30b5bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6483f9e3-bb0f-49ff-a80b-b0a7699db6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6483f9e3-bb0f-49ff-a80b-b0a7699db6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1533421079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea2421e-be35-4223-8aa8-dc368c14431f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04accdb00a384c45aaaf22df0bcb186f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:37:00Z,use_quota=True,user_id='d06ff9b4ba1a493d9d2679a0a457736b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5c3c8d-3059-411c-a1c0-08062ab90c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5c3c8d-3059-411c-a1c0-08062ab90c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0568bd-a695-4573-83dc-d1f8fb3627c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0568bd-a695-4573-83dc-d1f8fb3627c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bea2421e-be35-4223-8aa8-dc368c14431f', 'volume_name': 'volume-bea2421e-be35-4223-8aa8-dc368c14431f', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aefadc0f-5d4e-40eb-be96-e08a3c669a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aefadc0f-5d4e-40eb-be96-e08a3c669a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17668e36-4141-468d-86c9-b3eb91066a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:37:00 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Volume bea2421e-be35-4223-8aa8-dc368c14431f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bea2421e-be35-4223-8aa8-dc368c14431f', 'volume_size': 1}
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1533421079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea2421e-be35-4223-8aa8-dc368c14431f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04accdb00a384c45aaaf22df0bcb186f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:37:00Z,use_quota=True,user_id='d06ff9b4ba1a493d9d2679a0a457736b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Creating volume bea2421e-be35-4223-8aa8-dc368c14431f {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:37:00 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:00 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=21, name=volume-bea2421e-be35-4223-8aa8-dc368c14431f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f 1073741824" returned: 0 in 0.368s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f" returned: 0 in 0.108s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] <== create_volume: return (627ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:37:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.649s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:37:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17668e36-4141-468d-86c9-b3eb91066a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bea2421e-be35-4223-8aa8-dc368c14431f', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:37:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1616cbd5-4375-4af3-9a25-19d61abdc6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:37:01 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Volume volume-bea2421e-be35-4223-8aa8-dc368c14431f (bea2421e-be35-4223-8aa8-dc368c14431f): created successfully
Sep 10 11:37:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1616cbd5-4375-4af3-9a25-19d61abdc6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:37:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Flow 'volume_create_manager' (c2ee6f8b-dc0d-4116-960b-8017d30b5bac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:37:01 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-b2351b17-1cc7-4950-8772-895f90894e8b tempest-SnapshotsActionsTest-1578792883 None] Created volume successfully.
Sep 10 11:37:02 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-940c9eaa-8920-40bc-bdf3-e2aa1e92ce15 tempest-SnapshotsActionsTest-1578792883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:37:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-940c9eaa-8920-40bc-bdf3-e2aa1e92ce15 tempest-SnapshotsActionsTest-1578792883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:37:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-940c9eaa-8920-40bc-bdf3-e2aa1e92ce15 tempest-SnapshotsActionsTest-1578792883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:37:02 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-940c9eaa-8920-40bc-bdf3-e2aa1e92ce15 tempest-SnapshotsActionsTest-1578792883 None] Creating offline snapshot dee14786-60d0-444d-8cc7-7cb75a88f4af of volume bea2421e-be35-4223-8aa8-dc368c14431f {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 11:37:02 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfb8864-444b-417d-97dd-c635ac38af63]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:37:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-940c9eaa-8920-40bc-bdf3-e2aa1e92ce15 tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-940c9eaa-8920-40bc-bdf3-e2aa1e92ce15 tempest-SnapshotsActionsTest-1578792883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f" returned: 0 in 0.509s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-940c9eaa-8920-40bc-bdf3-e2aa1e92ce15 tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:03 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=22, name=volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:37:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-940c9eaa-8920-40bc-bdf3-e2aa1e92ce15 tempest-SnapshotsActionsTest-1578792883 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af 1G" returned: 0 in 0.269s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-940c9eaa-8920-40bc-bdf3-e2aa1e92ce15 tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bea2421e-be35-4223-8aa8-dc368c14431f -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-940c9eaa-8920-40bc-bdf3-e2aa1e92ce15 tempest-SnapshotsActionsTest-1578792883 None] CMD "qemu-img rebase -u -b volume-bea2421e-be35-4223-8aa8-dc368c14431f -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af" returned: 0 in 0.144s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-940c9eaa-8920-40bc-bdf3-e2aa1e92ce15 tempest-SnapshotsActionsTest-1578792883 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:37:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-940c9eaa-8920-40bc-bdf3-e2aa1e92ce15 tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-940c9eaa-8920-40bc-bdf3-e2aa1e92ce15 tempest-SnapshotsActionsTest-1578792883 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af" returned: 0 in 0.091s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:04 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-940c9eaa-8920-40bc-bdf3-e2aa1e92ce15 tempest-SnapshotsActionsTest-1578792883 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 11:37:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-940c9eaa-8920-40bc-bdf3-e2aa1e92ce15 tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-940c9eaa-8920-40bc-bdf3-e2aa1e92ce15 tempest-SnapshotsActionsTest-1578792883 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af" returned: 0 in 0.102s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-940c9eaa-8920-40bc-bdf3-e2aa1e92ce15 tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-940c9eaa-8920-40bc-bdf3-e2aa1e92ce15 tempest-SnapshotsActionsTest-1578792883 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.info" returned: 0 in 0.167s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:04 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-940c9eaa-8920-40bc-bdf3-e2aa1e92ce15 tempest-SnapshotsActionsTest-1578792883 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.info is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:37:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-940c9eaa-8920-40bc-bdf3-e2aa1e92ce15 tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-940c9eaa-8920-40bc-bdf3-e2aa1e92ce15 tempest-SnapshotsActionsTest-1578792883 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.info" returned: 0 in 0.128s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-940c9eaa-8920-40bc-bdf3-e2aa1e92ce15 tempest-SnapshotsActionsTest-1578792883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:37:05 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-940c9eaa-8920-40bc-bdf3-e2aa1e92ce15 tempest-SnapshotsActionsTest-1578792883 None] Create snapshot completed successfully
Sep 10 11:37:07 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:37:07 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:37:07 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Flow 'volume_create_manager' (508a9fba-efe3-402a-8bc8-8fe413c80e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:37:07 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a785d3-bf26-401b-afd2-1bede6a60788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:37:07 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a785d3-bf26-401b-afd2-1bede6a60788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1478696646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edcb6c0e-8e05-4f85-a022-3785bf39a1c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9987f31f8dd1465788a0c09d25fd87b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:37:07Z,use_quota=True,user_id='8d853555090c49368e7a0247b82a3a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:37:07 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (067a7461-a840-4c77-b3cd-80435882e5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:37:07 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (067a7461-a840-4c77-b3cd-80435882e5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:37:07 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8e2a95b-8d07-44d5-aa74-a1d020af7db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:37:07 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8e2a95b-8d07-44d5-aa74-a1d020af7db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edcb6c0e-8e05-4f85-a022-3785bf39a1c8', 'volume_name': 'volume-edcb6c0e-8e05-4f85-a022-3785bf39a1c8', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:37:07 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74315f0f-32a2-44df-9cf5-1c37eb2e2c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:37:07 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74315f0f-32a2-44df-9cf5-1c37eb2e2c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:37:07 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc65c261-f344-411f-b411-3730bab650ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:37:07 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Volume edcb6c0e-8e05-4f85-a022-3785bf39a1c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edcb6c0e-8e05-4f85-a022-3785bf39a1c8', 'volume_size': 1}
Sep 10 11:37:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:37:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:37:07 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1478696646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edcb6c0e-8e05-4f85-a022-3785bf39a1c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9987f31f8dd1465788a0c09d25fd87b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:37:07Z,use_quota=True,user_id='8d853555090c49368e7a0247b82a3a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:37:07 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Creating volume edcb6c0e-8e05-4f85-a022-3785bf39a1c8 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:37:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:37:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:37:07 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:37:07 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:37:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:37:07 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:37:07 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:37:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-edcb6c0e-8e05-4f85-a022-3785bf39a1c8 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:08 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-1cff374b-72e4-41f2-b4db-91da7ba9adfb tempest-SnapshotsActionsTest-1578792883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:37:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1cff374b-72e4-41f2-b4db-91da7ba9adfb tempest-SnapshotsActionsTest-1578792883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:37:08 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=24, name=volume-edcb6c0e-8e05-4f85-a022-3785bf39a1c8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:37:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-edcb6c0e-8e05-4f85-a022-3785bf39a1c8 1073741824" returned: 0 in 0.754s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-edcb6c0e-8e05-4f85-a022-3785bf39a1c8 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-edcb6c0e-8e05-4f85-a022-3785bf39a1c8" returned: 0 in 0.321s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] <== create_volume: return (1165ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:37:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:37:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1cff374b-72e4-41f2-b4db-91da7ba9adfb tempest-SnapshotsActionsTest-1578792883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.089s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:37:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-1cff374b-72e4-41f2-b4db-91da7ba9adfb tempest-SnapshotsActionsTest-1578792883 None] Creating offline snapshot 99835193-1148-4b07-b3e9-62a793918a56 of volume bea2421e-be35-4223-8aa8-dc368c14431f {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 11:37:09 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc65c261-f344-411f-b411-3730bab650ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edcb6c0e-8e05-4f85-a022-3785bf39a1c8', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:37:09 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a1e89ef-4c65-4381-b613-f65209564816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:37:09 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[642a83b3-abe7-4a78-bb93-cf212e35eff9]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:37:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1cff374b-72e4-41f2-b4db-91da7ba9adfb tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:10 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Volume volume-edcb6c0e-8e05-4f85-a022-3785bf39a1c8 (edcb6c0e-8e05-4f85-a022-3785bf39a1c8): created successfully
Sep 10 11:37:10 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a1e89ef-4c65-4381-b613-f65209564816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:37:10 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Flow 'volume_create_manager' (508a9fba-efe3-402a-8bc8-8fe413c80e72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:37:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1cff374b-72e4-41f2-b4db-91da7ba9adfb tempest-SnapshotsActionsTest-1578792883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af" returned: 0 in 0.795s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:10 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-1cff374b-72e4-41f2-b4db-91da7ba9adfb tempest-SnapshotsActionsTest-1578792883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bea2421e-be35-4223-8aa8-dc368c14431f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:37:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1cff374b-72e4-41f2-b4db-91da7ba9adfb tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.99835193-1148-4b07-b3e9-62a793918a56 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:10 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-caf6e7ba-d8b9-4ac4-a22f-9462f78b4824 tempest-AttachVolumeTestJSON-901448073 None] Created volume successfully.
Sep 10 11:37:10 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=25, name=volume-bea2421e-be35-4223-8aa8-dc368c14431f.99835193-1148-4b07-b3e9-62a793918a56, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:37:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1cff374b-72e4-41f2-b4db-91da7ba9adfb tempest-SnapshotsActionsTest-1578792883 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.99835193-1148-4b07-b3e9-62a793918a56 1G" returned: 0 in 0.513s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1cff374b-72e4-41f2-b4db-91da7ba9adfb tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.99835193-1148-4b07-b3e9-62a793918a56 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1cff374b-72e4-41f2-b4db-91da7ba9adfb tempest-SnapshotsActionsTest-1578792883 None] CMD "qemu-img rebase -u -b volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.99835193-1148-4b07-b3e9-62a793918a56" returned: 0 in 0.213s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-1cff374b-72e4-41f2-b4db-91da7ba9adfb tempest-SnapshotsActionsTest-1578792883 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.99835193-1148-4b07-b3e9-62a793918a56 is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:37:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1cff374b-72e4-41f2-b4db-91da7ba9adfb tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.99835193-1148-4b07-b3e9-62a793918a56 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1cff374b-72e4-41f2-b4db-91da7ba9adfb tempest-SnapshotsActionsTest-1578792883 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.99835193-1148-4b07-b3e9-62a793918a56" returned: 0 in 0.147s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-1cff374b-72e4-41f2-b4db-91da7ba9adfb tempest-SnapshotsActionsTest-1578792883 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 11:37:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1cff374b-72e4-41f2-b4db-91da7ba9adfb tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.99835193-1148-4b07-b3e9-62a793918a56 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1cff374b-72e4-41f2-b4db-91da7ba9adfb tempest-SnapshotsActionsTest-1578792883 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.99835193-1148-4b07-b3e9-62a793918a56" returned: 0 in 0.118s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1cff374b-72e4-41f2-b4db-91da7ba9adfb tempest-SnapshotsActionsTest-1578792883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.466s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:37:12 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-1cff374b-72e4-41f2-b4db-91da7ba9adfb tempest-SnapshotsActionsTest-1578792883 None] Create snapshot completed successfully
Sep 10 11:37:13 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-985b565c-a70b-4f92-8c2b-0b1fcd2d3a57 tempest-SnapshotsActionsTest-1231386107 None] Acquiring lock "cinder-99835193-1148-4b07-b3e9-62a793918a56-delete_snapshot" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:37:13 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-985b565c-a70b-4f92-8c2b-0b1fcd2d3a57 tempest-SnapshotsActionsTest-1231386107 None] Lock "cinder-99835193-1148-4b07-b3e9-62a793918a56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:37:13 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-985b565c-a70b-4f92-8c2b-0b1fcd2d3a57 tempest-SnapshotsActionsTest-1231386107 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:37:13 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-985b565c-a70b-4f92-8c2b-0b1fcd2d3a57 tempest-SnapshotsActionsTest-1231386107 None] Acquiring lock "cinder-quobyte-bea2421e-be35-4223-8aa8-dc368c14431f" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:37:13 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-985b565c-a70b-4f92-8c2b-0b1fcd2d3a57 tempest-SnapshotsActionsTest-1231386107 None] Lock "cinder-quobyte-bea2421e-be35-4223-8aa8-dc368c14431f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:37:13 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-985b565c-a70b-4f92-8c2b-0b1fcd2d3a57 tempest-SnapshotsActionsTest-1231386107 None] Acquiring lock "cinder-quobyte-99835193-1148-4b07-b3e9-62a793918a56" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:37:13 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-985b565c-a70b-4f92-8c2b-0b1fcd2d3a57 tempest-SnapshotsActionsTest-1231386107 None] Lock "cinder-quobyte-99835193-1148-4b07-b3e9-62a793918a56" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:37:13 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-985b565c-a70b-4f92-8c2b-0b1fcd2d3a57 tempest-SnapshotsActionsTest-1231386107 None] Deleting offline snapshot 99835193-1148-4b07-b3e9-62a793918a56 of volume bea2421e-be35-4223-8aa8-dc368c14431f {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 11:37:13 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-985b565c-a70b-4f92-8c2b-0b1fcd2d3a57 tempest-SnapshotsActionsTest-1231386107 None] snapshot_file for this snap is: volume-bea2421e-be35-4223-8aa8-dc368c14431f.99835193-1148-4b07-b3e9-62a793918a56 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 11:37:13 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01d1a39-486c-4de3-8c56-ca052ee2e03c]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:37:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-985b565c-a70b-4f92-8c2b-0b1fcd2d3a57 tempest-SnapshotsActionsTest-1231386107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.99835193-1148-4b07-b3e9-62a793918a56 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-985b565c-a70b-4f92-8c2b-0b1fcd2d3a57 tempest-SnapshotsActionsTest-1231386107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.99835193-1148-4b07-b3e9-62a793918a56" returned: 0 in 0.384s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:13 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-985b565c-a70b-4f92-8c2b-0b1fcd2d3a57 tempest-SnapshotsActionsTest-1231386107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bea2421e-be35-4223-8aa8-dc368c14431f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:37:14 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc3f6b2-0b63-4320-bd0d-ec6f9fca7692]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:37:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-985b565c-a70b-4f92-8c2b-0b1fcd2d3a57 tempest-SnapshotsActionsTest-1231386107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:14 devstack quobyte-client[82616]: System call of process 89200 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:37:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-985b565c-a70b-4f92-8c2b-0b1fcd2d3a57 tempest-SnapshotsActionsTest-1231386107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af" returned: 0 in 0.534s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:14 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-985b565c-a70b-4f92-8c2b-0b1fcd2d3a57 tempest-SnapshotsActionsTest-1231386107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bea2421e-be35-4223-8aa8-dc368c14431f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:37:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-985b565c-a70b-4f92-8c2b-0b1fcd2d3a57 tempest-SnapshotsActionsTest-1231386107 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.99835193-1148-4b07-b3e9-62a793918a56 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:14 devstack quobyte-client[82616]: System call of process 89210 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:37:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-985b565c-a70b-4f92-8c2b-0b1fcd2d3a57 tempest-SnapshotsActionsTest-1231386107 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.99835193-1148-4b07-b3e9-62a793918a56" returned: 0 in 0.410s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-985b565c-a70b-4f92-8c2b-0b1fcd2d3a57 tempest-SnapshotsActionsTest-1231386107 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.99835193-1148-4b07-b3e9-62a793918a56 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-985b565c-a70b-4f92-8c2b-0b1fcd2d3a57 tempest-SnapshotsActionsTest-1231386107 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.99835193-1148-4b07-b3e9-62a793918a56" returned: 0 in 0.317s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-6678ab00-5cf9-45cb-95db-04882b33c57f req-efa836e0-030c-4582-91fe-a0f436971ce5 tempest-AttachVolumeTestJSON-901448073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:37:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-6678ab00-5cf9-45cb-95db-04882b33c57f req-efa836e0-030c-4582-91fe-a0f436971ce5 tempest-AttachVolumeTestJSON-901448073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:37:15 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-985b565c-a70b-4f92-8c2b-0b1fcd2d3a57 tempest-SnapshotsActionsTest-1231386107 None] Lock "cinder-quobyte-99835193-1148-4b07-b3e9-62a793918a56" released by "_delete_snapshot" :: held 1.979s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:37:15 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31853d1-70a5-4ac6-8d13-482fc52a54c5]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:37:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-6678ab00-5cf9-45cb-95db-04882b33c57f req-efa836e0-030c-4582-91fe-a0f436971ce5 tempest-AttachVolumeTestJSON-901448073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-edcb6c0e-8e05-4f85-a022-3785bf39a1c8 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:15 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-985b565c-a70b-4f92-8c2b-0b1fcd2d3a57 tempest-SnapshotsActionsTest-1231386107 None] Lock "cinder-quobyte-bea2421e-be35-4223-8aa8-dc368c14431f" released by "delete_snapshot" :: held 2.132s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:37:15 devstack cinder-volume[82594]: WARNING cinder.quota [None req-985b565c-a70b-4f92-8c2b-0b1fcd2d3a57 tempest-SnapshotsActionsTest-1231386107 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:37:16 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-985b565c-a70b-4f92-8c2b-0b1fcd2d3a57 tempest-SnapshotsActionsTest-1231386107 None] Created reservations ['45b78e4f-d9bb-4e58-89a8-e4ff7eb4ae47', 'c7b72312-2f2c-4281-8420-82cdeb8c9d78', '32b4c3cd-b1bb-413c-a53b-cf3957d671ff', 'ea750c33-576b-4537-b640-ee36136f520d'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:37:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-6678ab00-5cf9-45cb-95db-04882b33c57f req-efa836e0-030c-4582-91fe-a0f436971ce5 tempest-AttachVolumeTestJSON-901448073 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-edcb6c0e-8e05-4f85-a022-3785bf39a1c8" returned: 0 in 0.578s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-6678ab00-5cf9-45cb-95db-04882b33c57f req-efa836e0-030c-4582-91fe-a0f436971ce5 tempest-AttachVolumeTestJSON-901448073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.639s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:37:16 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-985b565c-a70b-4f92-8c2b-0b1fcd2d3a57 tempest-SnapshotsActionsTest-1231386107 None] Delete snapshot completed successfully.
Sep 10 11:37:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-985b565c-a70b-4f92-8c2b-0b1fcd2d3a57 tempest-SnapshotsActionsTest-1231386107 None] Lock "cinder-99835193-1148-4b07-b3e9-62a793918a56-delete_snapshot" released by "delete_snapshot" :: held 2.715s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:37:16 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-6678ab00-5cf9-45cb-95db-04882b33c57f req-efa836e0-030c-4582-91fe-a0f436971ce5 tempest-AttachVolumeTestJSON-901448073 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56', 'name': 'volume-edcb6c0e-8e05-4f85-a022-3785bf39a1c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c152fbfb-4044-4947-929e-b1fd01b532b0', 'enforce_multipath': True} {{(pid=82594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 11:37:16 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-6678ab00-5cf9-45cb-95db-04882b33c57f req-efa836e0-030c-4582-91fe-a0f436971ce5 tempest-AttachVolumeTestJSON-901448073 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:37:16 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-6678ab00-5cf9-45cb-95db-04882b33c57f req-efa836e0-030c-4582-91fe-a0f436971ce5 tempest-AttachVolumeTestJSON-901448073 None] attachment_update completed successfully.
Sep 10 11:37:17 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-d43c54a2-64fd-4627-b348-b9bd913b49b5 tempest-SnapshotsActionsTest-1578792883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:37:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d43c54a2-64fd-4627-b348-b9bd913b49b5 tempest-SnapshotsActionsTest-1578792883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:37:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d43c54a2-64fd-4627-b348-b9bd913b49b5 tempest-SnapshotsActionsTest-1578792883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:37:17 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-d43c54a2-64fd-4627-b348-b9bd913b49b5 tempest-SnapshotsActionsTest-1578792883 None] Creating offline snapshot b75334bf-80a6-49c8-ade9-cdcd826802ed of volume bea2421e-be35-4223-8aa8-dc368c14431f {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 11:37:17 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f0e1aa-61e7-4be5-b5d1-7c84c8b59ac2]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:37:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d43c54a2-64fd-4627-b348-b9bd913b49b5 tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d43c54a2-64fd-4627-b348-b9bd913b49b5 tempest-SnapshotsActionsTest-1578792883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af" returned: 0 in 0.478s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:17 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-d43c54a2-64fd-4627-b348-b9bd913b49b5 tempest-SnapshotsActionsTest-1578792883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bea2421e-be35-4223-8aa8-dc368c14431f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:37:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d43c54a2-64fd-4627-b348-b9bd913b49b5 tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.b75334bf-80a6-49c8-ade9-cdcd826802ed 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:17 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=26, name=volume-bea2421e-be35-4223-8aa8-dc368c14431f.b75334bf-80a6-49c8-ade9-cdcd826802ed, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:37:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d43c54a2-64fd-4627-b348-b9bd913b49b5 tempest-SnapshotsActionsTest-1578792883 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.b75334bf-80a6-49c8-ade9-cdcd826802ed 1G" returned: 0 in 0.318s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d43c54a2-64fd-4627-b348-b9bd913b49b5 tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.b75334bf-80a6-49c8-ade9-cdcd826802ed {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d43c54a2-64fd-4627-b348-b9bd913b49b5 tempest-SnapshotsActionsTest-1578792883 None] CMD "qemu-img rebase -u -b volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.b75334bf-80a6-49c8-ade9-cdcd826802ed" returned: 0 in 0.224s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:18 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-d43c54a2-64fd-4627-b348-b9bd913b49b5 tempest-SnapshotsActionsTest-1578792883 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.b75334bf-80a6-49c8-ade9-cdcd826802ed is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:37:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d43c54a2-64fd-4627-b348-b9bd913b49b5 tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.b75334bf-80a6-49c8-ade9-cdcd826802ed {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d43c54a2-64fd-4627-b348-b9bd913b49b5 tempest-SnapshotsActionsTest-1578792883 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.b75334bf-80a6-49c8-ade9-cdcd826802ed" returned: 0 in 0.124s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:18 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-d43c54a2-64fd-4627-b348-b9bd913b49b5 tempest-SnapshotsActionsTest-1578792883 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 11:37:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d43c54a2-64fd-4627-b348-b9bd913b49b5 tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.b75334bf-80a6-49c8-ade9-cdcd826802ed {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d43c54a2-64fd-4627-b348-b9bd913b49b5 tempest-SnapshotsActionsTest-1578792883 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.b75334bf-80a6-49c8-ade9-cdcd826802ed" returned: 0 in 0.089s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d43c54a2-64fd-4627-b348-b9bd913b49b5 tempest-SnapshotsActionsTest-1578792883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.569s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:37:18 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-d43c54a2-64fd-4627-b348-b9bd913b49b5 tempest-SnapshotsActionsTest-1578792883 None] Create snapshot completed successfully
Sep 10 11:37:19 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bef1dbfe-0a5f-41bc-b6bd-48c278a9e82e tempest-SnapshotsActionsTest-1231386107 None] Acquiring lock "cinder-b75334bf-80a6-49c8-ade9-cdcd826802ed-delete_snapshot" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:37:19 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bef1dbfe-0a5f-41bc-b6bd-48c278a9e82e tempest-SnapshotsActionsTest-1231386107 None] Lock "cinder-b75334bf-80a6-49c8-ade9-cdcd826802ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:37:19 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-bef1dbfe-0a5f-41bc-b6bd-48c278a9e82e tempest-SnapshotsActionsTest-1231386107 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:37:19 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bef1dbfe-0a5f-41bc-b6bd-48c278a9e82e tempest-SnapshotsActionsTest-1231386107 None] Acquiring lock "cinder-quobyte-bea2421e-be35-4223-8aa8-dc368c14431f" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:37:19 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bef1dbfe-0a5f-41bc-b6bd-48c278a9e82e tempest-SnapshotsActionsTest-1231386107 None] Lock "cinder-quobyte-bea2421e-be35-4223-8aa8-dc368c14431f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:37:19 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bef1dbfe-0a5f-41bc-b6bd-48c278a9e82e tempest-SnapshotsActionsTest-1231386107 None] Acquiring lock "cinder-quobyte-b75334bf-80a6-49c8-ade9-cdcd826802ed" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:37:19 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bef1dbfe-0a5f-41bc-b6bd-48c278a9e82e tempest-SnapshotsActionsTest-1231386107 None] Lock "cinder-quobyte-b75334bf-80a6-49c8-ade9-cdcd826802ed" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:37:19 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-bef1dbfe-0a5f-41bc-b6bd-48c278a9e82e tempest-SnapshotsActionsTest-1231386107 None] Deleting offline snapshot b75334bf-80a6-49c8-ade9-cdcd826802ed of volume bea2421e-be35-4223-8aa8-dc368c14431f {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 11:37:19 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-bef1dbfe-0a5f-41bc-b6bd-48c278a9e82e tempest-SnapshotsActionsTest-1231386107 None] snapshot_file for this snap is: volume-bea2421e-be35-4223-8aa8-dc368c14431f.b75334bf-80a6-49c8-ade9-cdcd826802ed {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 11:37:19 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec6af07-b807-40d0-8d2d-1fa9738e8675]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:37:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bef1dbfe-0a5f-41bc-b6bd-48c278a9e82e tempest-SnapshotsActionsTest-1231386107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.b75334bf-80a6-49c8-ade9-cdcd826802ed {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bef1dbfe-0a5f-41bc-b6bd-48c278a9e82e tempest-SnapshotsActionsTest-1231386107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.b75334bf-80a6-49c8-ade9-cdcd826802ed" returned: 0 in 0.400s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:19 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-bef1dbfe-0a5f-41bc-b6bd-48c278a9e82e tempest-SnapshotsActionsTest-1231386107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bea2421e-be35-4223-8aa8-dc368c14431f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:37:19 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[47249d61-fbf2-4b72-a8a8-7274dc0c326c]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:37:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bef1dbfe-0a5f-41bc-b6bd-48c278a9e82e tempest-SnapshotsActionsTest-1231386107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bef1dbfe-0a5f-41bc-b6bd-48c278a9e82e tempest-SnapshotsActionsTest-1231386107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af" returned: 0 in 0.457s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:20 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-bef1dbfe-0a5f-41bc-b6bd-48c278a9e82e tempest-SnapshotsActionsTest-1231386107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bea2421e-be35-4223-8aa8-dc368c14431f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:37:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bef1dbfe-0a5f-41bc-b6bd-48c278a9e82e tempest-SnapshotsActionsTest-1231386107 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.b75334bf-80a6-49c8-ade9-cdcd826802ed {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bef1dbfe-0a5f-41bc-b6bd-48c278a9e82e tempest-SnapshotsActionsTest-1231386107 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.b75334bf-80a6-49c8-ade9-cdcd826802ed" returned: 0 in 0.242s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bef1dbfe-0a5f-41bc-b6bd-48c278a9e82e tempest-SnapshotsActionsTest-1231386107 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.b75334bf-80a6-49c8-ade9-cdcd826802ed {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bef1dbfe-0a5f-41bc-b6bd-48c278a9e82e tempest-SnapshotsActionsTest-1231386107 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.b75334bf-80a6-49c8-ade9-cdcd826802ed" returned: 0 in 0.087s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:20 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bef1dbfe-0a5f-41bc-b6bd-48c278a9e82e tempest-SnapshotsActionsTest-1231386107 None] Lock "cinder-quobyte-b75334bf-80a6-49c8-ade9-cdcd826802ed" released by "_delete_snapshot" :: held 1.445s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:37:20 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bef1dbfe-0a5f-41bc-b6bd-48c278a9e82e tempest-SnapshotsActionsTest-1231386107 None] Lock "cinder-quobyte-bea2421e-be35-4223-8aa8-dc368c14431f" released by "delete_snapshot" :: held 1.466s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:37:21 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-bef1dbfe-0a5f-41bc-b6bd-48c278a9e82e tempest-SnapshotsActionsTest-1231386107 None] Created reservations ['a39f4bc4-c50d-465c-a93c-6a303e261f58', '2c9875ac-7b20-4257-a2a1-389b2f72dda7', 'c5707205-601a-4ffb-8729-dbfc755d1c35', '68073fc6-d0be-4702-8601-3f8ee2a1362f'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:37:21 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-bef1dbfe-0a5f-41bc-b6bd-48c278a9e82e tempest-SnapshotsActionsTest-1231386107 None] Delete snapshot completed successfully.
Sep 10 11:37:21 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bef1dbfe-0a5f-41bc-b6bd-48c278a9e82e tempest-SnapshotsActionsTest-1231386107 None] Lock "cinder-b75334bf-80a6-49c8-ade9-cdcd826802ed-delete_snapshot" released by "delete_snapshot" :: held 1.939s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:37:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:37:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:37:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:37:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:37:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:37:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:37:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:22 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-69931a42-12c7-430b-8440-94b7b96bc8a9 tempest-SnapshotsActionsTest-1578792883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:37:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-69931a42-12c7-430b-8440-94b7b96bc8a9 tempest-SnapshotsActionsTest-1578792883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:37:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-69931a42-12c7-430b-8440-94b7b96bc8a9 tempest-SnapshotsActionsTest-1578792883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:37:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-69931a42-12c7-430b-8440-94b7b96bc8a9 tempest-SnapshotsActionsTest-1578792883 None] Creating offline snapshot 6af3f390-1e04-41ba-81a4-9833dfd8efb5 of volume bea2421e-be35-4223-8aa8-dc368c14431f {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 11:37:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.439s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:22 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:37:22 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2443b50-6b12-4e00-bf3b-406fc796aa61]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:37:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-69931a42-12c7-430b-8440-94b7b96bc8a9 tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:23 devstack quobyte-client[82616]: System call of process 89250 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:37:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-69931a42-12c7-430b-8440-94b7b96bc8a9 tempest-SnapshotsActionsTest-1578792883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af" returned: 0 in 0.418s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:23 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-69931a42-12c7-430b-8440-94b7b96bc8a9 tempest-SnapshotsActionsTest-1578792883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bea2421e-be35-4223-8aa8-dc368c14431f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:37:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-69931a42-12c7-430b-8440-94b7b96bc8a9 tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.6af3f390-1e04-41ba-81a4-9833dfd8efb5 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:23 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=27, name=volume-bea2421e-be35-4223-8aa8-dc368c14431f.6af3f390-1e04-41ba-81a4-9833dfd8efb5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:37:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-69931a42-12c7-430b-8440-94b7b96bc8a9 tempest-SnapshotsActionsTest-1578792883 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.6af3f390-1e04-41ba-81a4-9833dfd8efb5 1G" returned: 0 in 0.404s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-69931a42-12c7-430b-8440-94b7b96bc8a9 tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.6af3f390-1e04-41ba-81a4-9833dfd8efb5 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-69931a42-12c7-430b-8440-94b7b96bc8a9 tempest-SnapshotsActionsTest-1578792883 None] CMD "qemu-img rebase -u -b volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.6af3f390-1e04-41ba-81a4-9833dfd8efb5" returned: 0 in 0.295s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:23 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-69931a42-12c7-430b-8440-94b7b96bc8a9 tempest-SnapshotsActionsTest-1578792883 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.6af3f390-1e04-41ba-81a4-9833dfd8efb5 is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:37:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-69931a42-12c7-430b-8440-94b7b96bc8a9 tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.6af3f390-1e04-41ba-81a4-9833dfd8efb5 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-69931a42-12c7-430b-8440-94b7b96bc8a9 tempest-SnapshotsActionsTest-1578792883 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.6af3f390-1e04-41ba-81a4-9833dfd8efb5" returned: 0 in 0.143s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:24 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-69931a42-12c7-430b-8440-94b7b96bc8a9 tempest-SnapshotsActionsTest-1578792883 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 11:37:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-69931a42-12c7-430b-8440-94b7b96bc8a9 tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.6af3f390-1e04-41ba-81a4-9833dfd8efb5 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-69931a42-12c7-430b-8440-94b7b96bc8a9 tempest-SnapshotsActionsTest-1578792883 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.6af3f390-1e04-41ba-81a4-9833dfd8efb5" returned: 0 in 0.159s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-69931a42-12c7-430b-8440-94b7b96bc8a9 tempest-SnapshotsActionsTest-1578792883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.982s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:37:24 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-69931a42-12c7-430b-8440-94b7b96bc8a9 tempest-SnapshotsActionsTest-1578792883 None] Create snapshot completed successfully
Sep 10 11:37:25 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-14f65cd7-dea5-495a-841a-5fa2d49374e7 tempest-SnapshotsActionsTest-1231386107 None] Acquiring lock "cinder-6af3f390-1e04-41ba-81a4-9833dfd8efb5-delete_snapshot" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:37:25 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-14f65cd7-dea5-495a-841a-5fa2d49374e7 tempest-SnapshotsActionsTest-1231386107 None] Lock "cinder-6af3f390-1e04-41ba-81a4-9833dfd8efb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:37:25 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-14f65cd7-dea5-495a-841a-5fa2d49374e7 tempest-SnapshotsActionsTest-1231386107 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:37:25 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-14f65cd7-dea5-495a-841a-5fa2d49374e7 tempest-SnapshotsActionsTest-1231386107 None] Acquiring lock "cinder-quobyte-bea2421e-be35-4223-8aa8-dc368c14431f" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:37:25 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-14f65cd7-dea5-495a-841a-5fa2d49374e7 tempest-SnapshotsActionsTest-1231386107 None] Lock "cinder-quobyte-bea2421e-be35-4223-8aa8-dc368c14431f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:37:25 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-14f65cd7-dea5-495a-841a-5fa2d49374e7 tempest-SnapshotsActionsTest-1231386107 None] Acquiring lock "cinder-quobyte-6af3f390-1e04-41ba-81a4-9833dfd8efb5" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:37:25 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-14f65cd7-dea5-495a-841a-5fa2d49374e7 tempest-SnapshotsActionsTest-1231386107 None] Lock "cinder-quobyte-6af3f390-1e04-41ba-81a4-9833dfd8efb5" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:37:25 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-14f65cd7-dea5-495a-841a-5fa2d49374e7 tempest-SnapshotsActionsTest-1231386107 None] Deleting offline snapshot 6af3f390-1e04-41ba-81a4-9833dfd8efb5 of volume bea2421e-be35-4223-8aa8-dc368c14431f {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 11:37:25 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-14f65cd7-dea5-495a-841a-5fa2d49374e7 tempest-SnapshotsActionsTest-1231386107 None] snapshot_file for this snap is: volume-bea2421e-be35-4223-8aa8-dc368c14431f.6af3f390-1e04-41ba-81a4-9833dfd8efb5 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 11:37:25 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[008848fb-9132-4263-9631-0858d6eac502]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:37:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-14f65cd7-dea5-495a-841a-5fa2d49374e7 tempest-SnapshotsActionsTest-1231386107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.6af3f390-1e04-41ba-81a4-9833dfd8efb5 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-14f65cd7-dea5-495a-841a-5fa2d49374e7 tempest-SnapshotsActionsTest-1231386107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.6af3f390-1e04-41ba-81a4-9833dfd8efb5" returned: 0 in 0.386s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:25 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-14f65cd7-dea5-495a-841a-5fa2d49374e7 tempest-SnapshotsActionsTest-1231386107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bea2421e-be35-4223-8aa8-dc368c14431f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:37:26 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0952f8bc-33ed-4212-b28f-497d1ee04a36]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:37:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-14f65cd7-dea5-495a-841a-5fa2d49374e7 tempest-SnapshotsActionsTest-1231386107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-14f65cd7-dea5-495a-841a-5fa2d49374e7 tempest-SnapshotsActionsTest-1231386107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af" returned: 0 in 0.384s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-14f65cd7-dea5-495a-841a-5fa2d49374e7 tempest-SnapshotsActionsTest-1231386107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bea2421e-be35-4223-8aa8-dc368c14431f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:37:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-14f65cd7-dea5-495a-841a-5fa2d49374e7 tempest-SnapshotsActionsTest-1231386107 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.6af3f390-1e04-41ba-81a4-9833dfd8efb5 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:26 devstack quobyte-client[82616]: System call of process 89312 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:37:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-14f65cd7-dea5-495a-841a-5fa2d49374e7 tempest-SnapshotsActionsTest-1231386107 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.6af3f390-1e04-41ba-81a4-9833dfd8efb5" returned: 0 in 0.235s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-14f65cd7-dea5-495a-841a-5fa2d49374e7 tempest-SnapshotsActionsTest-1231386107 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.6af3f390-1e04-41ba-81a4-9833dfd8efb5 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-14f65cd7-dea5-495a-841a-5fa2d49374e7 tempest-SnapshotsActionsTest-1231386107 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.6af3f390-1e04-41ba-81a4-9833dfd8efb5" returned: 0 in 0.099s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:26 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-14f65cd7-dea5-495a-841a-5fa2d49374e7 tempest-SnapshotsActionsTest-1231386107 None] Lock "cinder-quobyte-6af3f390-1e04-41ba-81a4-9833dfd8efb5" released by "_delete_snapshot" :: held 1.388s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:37:26 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-14f65cd7-dea5-495a-841a-5fa2d49374e7 tempest-SnapshotsActionsTest-1231386107 None] Lock "cinder-quobyte-bea2421e-be35-4223-8aa8-dc368c14431f" released by "delete_snapshot" :: held 1.417s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:37:27 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-14f65cd7-dea5-495a-841a-5fa2d49374e7 tempest-SnapshotsActionsTest-1231386107 None] Created reservations ['4bc9af88-f25f-4235-8221-940f8418fe8d', '23d06fa0-7583-406f-8862-b68febe88e04', 'f58af93b-66af-4c72-800f-335f0ad79de2', '173e9c11-2bf6-458d-bd2c-45f2c656d61f'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:37:27 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-14f65cd7-dea5-495a-841a-5fa2d49374e7 tempest-SnapshotsActionsTest-1231386107 None] Delete snapshot completed successfully.
Sep 10 11:37:27 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-14f65cd7-dea5-495a-841a-5fa2d49374e7 tempest-SnapshotsActionsTest-1231386107 None] Lock "cinder-6af3f390-1e04-41ba-81a4-9833dfd8efb5-delete_snapshot" released by "delete_snapshot" :: held 1.906s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:37:28 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-a1d466cb-fe04-44b1-ac9d-a85406953d89 tempest-SnapshotsActionsTest-1578792883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:37:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a1d466cb-fe04-44b1-ac9d-a85406953d89 tempest-SnapshotsActionsTest-1578792883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:37:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a1d466cb-fe04-44b1-ac9d-a85406953d89 tempest-SnapshotsActionsTest-1578792883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:37:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-a1d466cb-fe04-44b1-ac9d-a85406953d89 tempest-SnapshotsActionsTest-1578792883 None] Creating offline snapshot 58eb7ebb-9a0e-4271-b357-8961635f25ca of volume bea2421e-be35-4223-8aa8-dc368c14431f {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 11:37:28 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4e7a9b-96ab-4eb6-8065-dcdb781c9612]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:37:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1d466cb-fe04-44b1-ac9d-a85406953d89 tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1d466cb-fe04-44b1-ac9d-a85406953d89 tempest-SnapshotsActionsTest-1578792883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af" returned: 0 in 0.412s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-a1d466cb-fe04-44b1-ac9d-a85406953d89 tempest-SnapshotsActionsTest-1578792883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bea2421e-be35-4223-8aa8-dc368c14431f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:37:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1d466cb-fe04-44b1-ac9d-a85406953d89 tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.58eb7ebb-9a0e-4271-b357-8961635f25ca 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:28 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=28, name=volume-bea2421e-be35-4223-8aa8-dc368c14431f.58eb7ebb-9a0e-4271-b357-8961635f25ca, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:37:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1d466cb-fe04-44b1-ac9d-a85406953d89 tempest-SnapshotsActionsTest-1578792883 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.58eb7ebb-9a0e-4271-b357-8961635f25ca 1G" returned: 0 in 0.264s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1d466cb-fe04-44b1-ac9d-a85406953d89 tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.58eb7ebb-9a0e-4271-b357-8961635f25ca {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1d466cb-fe04-44b1-ac9d-a85406953d89 tempest-SnapshotsActionsTest-1578792883 None] CMD "qemu-img rebase -u -b volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.58eb7ebb-9a0e-4271-b357-8961635f25ca" returned: 0 in 0.141s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-a1d466cb-fe04-44b1-ac9d-a85406953d89 tempest-SnapshotsActionsTest-1578792883 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.58eb7ebb-9a0e-4271-b357-8961635f25ca is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:37:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1d466cb-fe04-44b1-ac9d-a85406953d89 tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.58eb7ebb-9a0e-4271-b357-8961635f25ca {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1d466cb-fe04-44b1-ac9d-a85406953d89 tempest-SnapshotsActionsTest-1578792883 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.58eb7ebb-9a0e-4271-b357-8961635f25ca" returned: 0 in 0.077s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-a1d466cb-fe04-44b1-ac9d-a85406953d89 tempest-SnapshotsActionsTest-1578792883 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 11:37:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1d466cb-fe04-44b1-ac9d-a85406953d89 tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.58eb7ebb-9a0e-4271-b357-8961635f25ca {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1d466cb-fe04-44b1-ac9d-a85406953d89 tempest-SnapshotsActionsTest-1578792883 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.58eb7ebb-9a0e-4271-b357-8961635f25ca" returned: 0 in 0.089s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a1d466cb-fe04-44b1-ac9d-a85406953d89 tempest-SnapshotsActionsTest-1578792883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.224s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:37:29 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-a1d466cb-fe04-44b1-ac9d-a85406953d89 tempest-SnapshotsActionsTest-1578792883 None] Create snapshot completed successfully
Sep 10 11:37:30 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d13b4663-9434-4f99-8996-c7756f7c40d9 tempest-SnapshotsActionsTest-1231386107 None] Acquiring lock "cinder-58eb7ebb-9a0e-4271-b357-8961635f25ca-delete_snapshot" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:37:30 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d13b4663-9434-4f99-8996-c7756f7c40d9 tempest-SnapshotsActionsTest-1231386107 None] Lock "cinder-58eb7ebb-9a0e-4271-b357-8961635f25ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:37:30 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-d13b4663-9434-4f99-8996-c7756f7c40d9 tempest-SnapshotsActionsTest-1231386107 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:37:30 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d13b4663-9434-4f99-8996-c7756f7c40d9 tempest-SnapshotsActionsTest-1231386107 None] Acquiring lock "cinder-quobyte-bea2421e-be35-4223-8aa8-dc368c14431f" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:37:30 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d13b4663-9434-4f99-8996-c7756f7c40d9 tempest-SnapshotsActionsTest-1231386107 None] Lock "cinder-quobyte-bea2421e-be35-4223-8aa8-dc368c14431f" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:37:30 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d13b4663-9434-4f99-8996-c7756f7c40d9 tempest-SnapshotsActionsTest-1231386107 None] Acquiring lock "cinder-quobyte-58eb7ebb-9a0e-4271-b357-8961635f25ca" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:37:30 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d13b4663-9434-4f99-8996-c7756f7c40d9 tempest-SnapshotsActionsTest-1231386107 None] Lock "cinder-quobyte-58eb7ebb-9a0e-4271-b357-8961635f25ca" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:37:30 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-d13b4663-9434-4f99-8996-c7756f7c40d9 tempest-SnapshotsActionsTest-1231386107 None] Deleting offline snapshot 58eb7ebb-9a0e-4271-b357-8961635f25ca of volume bea2421e-be35-4223-8aa8-dc368c14431f {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 11:37:30 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-d13b4663-9434-4f99-8996-c7756f7c40d9 tempest-SnapshotsActionsTest-1231386107 None] snapshot_file for this snap is: volume-bea2421e-be35-4223-8aa8-dc368c14431f.58eb7ebb-9a0e-4271-b357-8961635f25ca {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 11:37:30 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ebcf6c-87a7-4e82-a2b2-9cbbc405e612]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:37:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d13b4663-9434-4f99-8996-c7756f7c40d9 tempest-SnapshotsActionsTest-1231386107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.58eb7ebb-9a0e-4271-b357-8961635f25ca {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:30 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-da096e69-6239-4d04-bead-33a713d94009 req-2e80db8a-a8ae-4de2-9d89-5de9c3246404 tempest-AttachVolumeShelveTestJSON-1374435819 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:37:30 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=61,cinder:UPDATE=46,cinder:DELETE=5,cinder:INSERT=13 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:37:30 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-da096e69-6239-4d04-bead-33a713d94009 req-2e80db8a-a8ae-4de2-9d89-5de9c3246404 tempest-AttachVolumeShelveTestJSON-1374435819 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:37:30 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-da096e69-6239-4d04-bead-33a713d94009 req-2e80db8a-a8ae-4de2-9d89-5de9c3246404 tempest-AttachVolumeShelveTestJSON-1374435819 None] Terminate volume connection completed successfully.
Sep 10 11:37:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-da096e69-6239-4d04-bead-33a713d94009 req-2e80db8a-a8ae-4de2-9d89-5de9c3246404 tempest-AttachVolumeShelveTestJSON-1374435819 None] Deleting attachment 030fbaa8-e6e7-4faf-a5ae-a73d52195eb7. {{(pid=82594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 11:37:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d13b4663-9434-4f99-8996-c7756f7c40d9 tempest-SnapshotsActionsTest-1231386107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.58eb7ebb-9a0e-4271-b357-8961635f25ca" returned: 0 in 0.550s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:31 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-d13b4663-9434-4f99-8996-c7756f7c40d9 tempest-SnapshotsActionsTest-1231386107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bea2421e-be35-4223-8aa8-dc368c14431f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:37:31 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a97918b-9803-4ff9-9e3a-bd058ec4413a]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:37:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d13b4663-9434-4f99-8996-c7756f7c40d9 tempest-SnapshotsActionsTest-1231386107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d13b4663-9434-4f99-8996-c7756f7c40d9 tempest-SnapshotsActionsTest-1231386107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af" returned: 0 in 0.406s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:31 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-d13b4663-9434-4f99-8996-c7756f7c40d9 tempest-SnapshotsActionsTest-1231386107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bea2421e-be35-4223-8aa8-dc368c14431f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:37:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d13b4663-9434-4f99-8996-c7756f7c40d9 tempest-SnapshotsActionsTest-1231386107 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.58eb7ebb-9a0e-4271-b357-8961635f25ca {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d13b4663-9434-4f99-8996-c7756f7c40d9 tempest-SnapshotsActionsTest-1231386107 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.58eb7ebb-9a0e-4271-b357-8961635f25ca" returned: 0 in 0.218s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d13b4663-9434-4f99-8996-c7756f7c40d9 tempest-SnapshotsActionsTest-1231386107 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.58eb7ebb-9a0e-4271-b357-8961635f25ca {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d13b4663-9434-4f99-8996-c7756f7c40d9 tempest-SnapshotsActionsTest-1231386107 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.58eb7ebb-9a0e-4271-b357-8961635f25ca" returned: 0 in 0.081s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:31 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d13b4663-9434-4f99-8996-c7756f7c40d9 tempest-SnapshotsActionsTest-1231386107 None] Lock "cinder-quobyte-58eb7ebb-9a0e-4271-b357-8961635f25ca" released by "_delete_snapshot" :: held 1.529s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:37:32 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d13b4663-9434-4f99-8996-c7756f7c40d9 tempest-SnapshotsActionsTest-1231386107 None] Lock "cinder-quobyte-bea2421e-be35-4223-8aa8-dc368c14431f" released by "delete_snapshot" :: held 1.572s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:37:32 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=59,cinder:UPDATE=58,cinder:INSERT=8,cinder:DELETE=4 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:37:32 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-d13b4663-9434-4f99-8996-c7756f7c40d9 tempest-SnapshotsActionsTest-1231386107 None] Created reservations ['29936894-8a23-45cf-b2ea-54ff9d354e37', '7c8d7899-b1fe-4a8f-a228-7cbbe1bb9ddc', '56f41c8c-70fa-4530-bc31-ddbc5de813e4', '37a8a523-c741-4f52-a4bd-5c345504b988'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:37:32 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-d13b4663-9434-4f99-8996-c7756f7c40d9 tempest-SnapshotsActionsTest-1231386107 None] Delete snapshot completed successfully.
Sep 10 11:37:32 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d13b4663-9434-4f99-8996-c7756f7c40d9 tempest-SnapshotsActionsTest-1231386107 None] Lock "cinder-58eb7ebb-9a0e-4271-b357-8961635f25ca-delete_snapshot" released by "delete_snapshot" :: held 2.124s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:37:35 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-07b39167-6faf-4e73-a9d4-d7106b7f548d tempest-SnapshotsActionsTest-1578792883 None] Acquiring lock "cinder-dee14786-60d0-444d-8cc7-7cb75a88f4af-delete_snapshot" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:37:35 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-07b39167-6faf-4e73-a9d4-d7106b7f548d tempest-SnapshotsActionsTest-1578792883 None] Lock "cinder-dee14786-60d0-444d-8cc7-7cb75a88f4af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:37:35 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-07b39167-6faf-4e73-a9d4-d7106b7f548d tempest-SnapshotsActionsTest-1578792883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:37:35 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-07b39167-6faf-4e73-a9d4-d7106b7f548d tempest-SnapshotsActionsTest-1578792883 None] Acquiring lock "cinder-quobyte-bea2421e-be35-4223-8aa8-dc368c14431f" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:37:35 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-07b39167-6faf-4e73-a9d4-d7106b7f548d tempest-SnapshotsActionsTest-1578792883 None] Lock "cinder-quobyte-bea2421e-be35-4223-8aa8-dc368c14431f" acquired by "delete_snapshot" :: waited 0.040s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:37:35 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-07b39167-6faf-4e73-a9d4-d7106b7f548d tempest-SnapshotsActionsTest-1578792883 None] Acquiring lock "cinder-quobyte-dee14786-60d0-444d-8cc7-7cb75a88f4af" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:37:35 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-07b39167-6faf-4e73-a9d4-d7106b7f548d tempest-SnapshotsActionsTest-1578792883 None] Lock "cinder-quobyte-dee14786-60d0-444d-8cc7-7cb75a88f4af" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:37:35 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-07b39167-6faf-4e73-a9d4-d7106b7f548d tempest-SnapshotsActionsTest-1578792883 None] Deleting offline snapshot dee14786-60d0-444d-8cc7-7cb75a88f4af of volume bea2421e-be35-4223-8aa8-dc368c14431f {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 11:37:35 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-07b39167-6faf-4e73-a9d4-d7106b7f548d tempest-SnapshotsActionsTest-1578792883 None] snapshot_file for this snap is: volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 11:37:35 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[061ce729-b0dc-428b-84a6-94ba0e47e7f2]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:37:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-07b39167-6faf-4e73-a9d4-d7106b7f548d tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-07b39167-6faf-4e73-a9d4-d7106b7f548d tempest-SnapshotsActionsTest-1578792883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af" returned: 0 in 0.493s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:35 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-07b39167-6faf-4e73-a9d4-d7106b7f548d tempest-SnapshotsActionsTest-1578792883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bea2421e-be35-4223-8aa8-dc368c14431f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:37:35 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c34a9a-9455-4ff0-bcdd-18c9244f533f]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:37:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-07b39167-6faf-4e73-a9d4-d7106b7f548d tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-07b39167-6faf-4e73-a9d4-d7106b7f548d tempest-SnapshotsActionsTest-1578792883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f" returned: 0 in 0.528s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-07b39167-6faf-4e73-a9d4-d7106b7f548d tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:36 devstack quobyte-client[82616]: System call of process 89387 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:37:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-07b39167-6faf-4e73-a9d4-d7106b7f548d tempest-SnapshotsActionsTest-1578792883 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af" returned: 0 in 0.294s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-07b39167-6faf-4e73-a9d4-d7106b7f548d tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-07b39167-6faf-4e73-a9d4-d7106b7f548d tempest-SnapshotsActionsTest-1578792883 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f.dee14786-60d0-444d-8cc7-7cb75a88f4af" returned: 0 in 0.122s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:36 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-07b39167-6faf-4e73-a9d4-d7106b7f548d tempest-SnapshotsActionsTest-1578792883 None] Lock "cinder-quobyte-dee14786-60d0-444d-8cc7-7cb75a88f4af" released by "_delete_snapshot" :: held 1.812s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:37:36 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-07b39167-6faf-4e73-a9d4-d7106b7f548d tempest-SnapshotsActionsTest-1578792883 None] Lock "cinder-quobyte-bea2421e-be35-4223-8aa8-dc368c14431f" released by "delete_snapshot" :: held 1.835s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:37:37 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-07b39167-6faf-4e73-a9d4-d7106b7f548d tempest-SnapshotsActionsTest-1578792883 None] Created reservations ['58ad4692-8317-49fd-a3f2-5dd3dacfd3a6', 'b3a044e4-fe23-4531-a27b-e674ac4d33f3', 'f2a4e4b6-51f9-4cb9-be43-ed2f356c7327', 'edf9b2bc-829a-4e72-9a3f-a46bb4cecae9'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:37:37 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-07b39167-6faf-4e73-a9d4-d7106b7f548d tempest-SnapshotsActionsTest-1578792883 None] Delete snapshot completed successfully.
Sep 10 11:37:37 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-07b39167-6faf-4e73-a9d4-d7106b7f548d tempest-SnapshotsActionsTest-1578792883 None] Lock "cinder-dee14786-60d0-444d-8cc7-7cb75a88f4af-delete_snapshot" released by "delete_snapshot" :: held 2.612s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:37:38 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-32e9f753-2b0d-4345-b043-2566014e9c0d tempest-SnapshotsActionsTest-1578792883 None] Acquiring lock "cinder-bea2421e-be35-4223-8aa8-dc368c14431f-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:37:38 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-32e9f753-2b0d-4345-b043-2566014e9c0d tempest-SnapshotsActionsTest-1578792883 None] Lock "cinder-bea2421e-be35-4223-8aa8-dc368c14431f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:37:38 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-32e9f753-2b0d-4345-b043-2566014e9c0d tempest-SnapshotsActionsTest-1578792883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:37:38 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-32e9f753-2b0d-4345-b043-2566014e9c0d tempest-SnapshotsActionsTest-1578792883 None] Acquiring lock "cinder-quobyte-bea2421e-be35-4223-8aa8-dc368c14431f" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:37:38 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-32e9f753-2b0d-4345-b043-2566014e9c0d tempest-SnapshotsActionsTest-1578792883 None] Lock "cinder-quobyte-bea2421e-be35-4223-8aa8-dc368c14431f" acquired by "delete_volume" :: waited 0.025s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:37:38 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e4be24-b433-4a75-8daa-168f41e00722]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:37:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-32e9f753-2b0d-4345-b043-2566014e9c0d tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-32e9f753-2b0d-4345-b043-2566014e9c0d tempest-SnapshotsActionsTest-1578792883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f" returned: 0 in 0.417s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-32e9f753-2b0d-4345-b043-2566014e9c0d tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-32e9f753-2b0d-4345-b043-2566014e9c0d tempest-SnapshotsActionsTest-1578792883 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bea2421e-be35-4223-8aa8-dc368c14431f" returned: 0 in 0.130s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:39 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-32e9f753-2b0d-4345-b043-2566014e9c0d tempest-SnapshotsActionsTest-1578792883 None] Lock "cinder-quobyte-bea2421e-be35-4223-8aa8-dc368c14431f" released by "delete_volume" :: held 0.766s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:37:39 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-32e9f753-2b0d-4345-b043-2566014e9c0d tempest-SnapshotsActionsTest-1578792883 None] Created reservations ['3b8f553e-8a35-4aa8-9c55-49f47b3d940f', '274b390a-a191-4011-88c9-27067e20ff36', 'c5c72660-5e22-4922-999b-304885d636ea', '8c1c08ab-e5eb-4f6c-b760-32815f9e1f70'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:37:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-32e9f753-2b0d-4345-b043-2566014e9c0d tempest-SnapshotsActionsTest-1578792883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:37:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-32e9f753-2b0d-4345-b043-2566014e9c0d tempest-SnapshotsActionsTest-1578792883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:37:39 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-32e9f753-2b0d-4345-b043-2566014e9c0d tempest-SnapshotsActionsTest-1578792883 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:37:39 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-32e9f753-2b0d-4345-b043-2566014e9c0d tempest-SnapshotsActionsTest-1578792883 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:37:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-32e9f753-2b0d-4345-b043-2566014e9c0d tempest-SnapshotsActionsTest-1578792883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:37:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-32e9f753-2b0d-4345-b043-2566014e9c0d tempest-SnapshotsActionsTest-1578792883 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-32e9f753-2b0d-4345-b043-2566014e9c0d tempest-SnapshotsActionsTest-1578792883 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.080s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:37:39 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-32e9f753-2b0d-4345-b043-2566014e9c0d tempest-SnapshotsActionsTest-1578792883 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:37:39 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-32e9f753-2b0d-4345-b043-2566014e9c0d tempest-SnapshotsActionsTest-1578792883 None] Deleted volume successfully.
Sep 10 11:37:40 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-32e9f753-2b0d-4345-b043-2566014e9c0d tempest-SnapshotsActionsTest-1578792883 None] Lock "cinder-bea2421e-be35-4223-8aa8-dc368c14431f-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:37:44 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-61269c7d-6b6f-422b-af5e-18dffd302cb5 req-cefe4c9c-b782-4b4a-9dfc-7982198b1325 tempest-AttachVolumeTestJSON-901448073 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:37:44 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-61269c7d-6b6f-422b-af5e-18dffd302cb5 req-cefe4c9c-b782-4b4a-9dfc-7982198b1325 tempest-AttachVolumeTestJSON-901448073 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:37:44 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-61269c7d-6b6f-422b-af5e-18dffd302cb5 req-cefe4c9c-b782-4b4a-9dfc-7982198b1325 tempest-AttachVolumeTestJSON-901448073 None] Terminate volume connection completed successfully.
Sep 10 11:37:44 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-61269c7d-6b6f-422b-af5e-18dffd302cb5 req-cefe4c9c-b782-4b4a-9dfc-7982198b1325 tempest-AttachVolumeTestJSON-901448073 None] Deleting attachment cb123b75-1586-4daa-aa8d-de680305c266. {{(pid=82594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 11:37:54 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=15,cinder:INSERT=3,cinder:UPDATE=20 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:37:54 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:INSERT=9,cinder:UPDATE=18,cinder:SELECT=14,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:37:59 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:37:59 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:37:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Flow 'volume_create_manager' (b3af32c5-34fb-495d-82b4-aa8bf294a62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:37:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9be49bf-cca1-4469-a870-ffa037ff6e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:37:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9be49bf-cca1-4469-a870-ffa037ff6e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-277429873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06fe2233-8084-461f-9ec4-8755503954b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f82cec0bcb4d999719f235b57ddfd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:37:59Z,use_quota=True,user_id='1f8a2cebf8ca48049bcaa7169d7c9cac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:37:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd8fd9a-508c-4354-9fca-8a771bf9c739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:37:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd8fd9a-508c-4354-9fca-8a771bf9c739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:37:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ecf6438-3a23-4892-99b9-6d69500e6b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:37:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ecf6438-3a23-4892-99b9-6d69500e6b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06fe2233-8084-461f-9ec4-8755503954b2', 'volume_name': 'volume-06fe2233-8084-461f-9ec4-8755503954b2', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:37:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b21e021a-86bb-4b24-9e1b-6dbfa2074392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:37:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b21e021a-86bb-4b24-9e1b-6dbfa2074392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:37:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01f8d3d-d525-43f8-a58e-7431996d67e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:37:59 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Volume 06fe2233-8084-461f-9ec4-8755503954b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06fe2233-8084-461f-9ec4-8755503954b2', 'volume_size': 1}
Sep 10 11:37:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:37:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:37:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-277429873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06fe2233-8084-461f-9ec4-8755503954b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f82cec0bcb4d999719f235b57ddfd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:37:59Z,use_quota=True,user_id='1f8a2cebf8ca48049bcaa7169d7c9cac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:37:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Creating volume 06fe2233-8084-461f-9ec4-8755503954b2 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:37:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:37:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:37:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:37:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:37:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:37:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:37:59 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:37:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-06fe2233-8084-461f-9ec4-8755503954b2 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:37:59 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=29, name=volume-06fe2233-8084-461f-9ec4-8755503954b2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:38:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-06fe2233-8084-461f-9ec4-8755503954b2 1073741824" returned: 0 in 0.539s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-06fe2233-8084-461f-9ec4-8755503954b2 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-06fe2233-8084-461f-9ec4-8755503954b2" returned: 0 in 0.137s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] <== create_volume: return (802ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:38:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:38:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01f8d3d-d525-43f8-a58e-7431996d67e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06fe2233-8084-461f-9ec4-8755503954b2', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:38:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3109c70-312a-4b0a-b1ae-5327a41138d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:38:00 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Volume volume-06fe2233-8084-461f-9ec4-8755503954b2 (06fe2233-8084-461f-9ec4-8755503954b2): created successfully
Sep 10 11:38:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3109c70-312a-4b0a-b1ae-5327a41138d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:38:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Flow 'volume_create_manager' (b3af32c5-34fb-495d-82b4-aa8bf294a62d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:38:00 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-7d9e0ef8-7de1-41c3-89e0-6ee6b7510436 tempest-VolumesServicesTestJSON-106773284 None] Created volume successfully.
Sep 10 11:38:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fa94c2e4-f85b-465f-bedb-5c906955b39d tempest-VolumesServicesTestJSON-106773284 None] Acquiring lock "cinder-06fe2233-8084-461f-9ec4-8755503954b2-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:38:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fa94c2e4-f85b-465f-bedb-5c906955b39d tempest-VolumesServicesTestJSON-106773284 None] Lock "cinder-06fe2233-8084-461f-9ec4-8755503954b2-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:38:01 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-fa94c2e4-f85b-465f-bedb-5c906955b39d tempest-VolumesServicesTestJSON-106773284 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:38:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fa94c2e4-f85b-465f-bedb-5c906955b39d tempest-VolumesServicesTestJSON-106773284 None] Acquiring lock "cinder-quobyte-06fe2233-8084-461f-9ec4-8755503954b2" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:38:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fa94c2e4-f85b-465f-bedb-5c906955b39d tempest-VolumesServicesTestJSON-106773284 None] Lock "cinder-quobyte-06fe2233-8084-461f-9ec4-8755503954b2" acquired by "delete_volume" :: waited 0.024s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:38:02 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[18904899-1026-41b3-9218-532e6dfe8866]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:38:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fa94c2e4-f85b-465f-bedb-5c906955b39d tempest-VolumesServicesTestJSON-106773284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-06fe2233-8084-461f-9ec4-8755503954b2 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fa94c2e4-f85b-465f-bedb-5c906955b39d tempest-VolumesServicesTestJSON-106773284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-06fe2233-8084-461f-9ec4-8755503954b2" returned: 0 in 0.545s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fa94c2e4-f85b-465f-bedb-5c906955b39d tempest-VolumesServicesTestJSON-106773284 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-06fe2233-8084-461f-9ec4-8755503954b2 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fa94c2e4-f85b-465f-bedb-5c906955b39d tempest-VolumesServicesTestJSON-106773284 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-06fe2233-8084-461f-9ec4-8755503954b2" returned: 0 in 0.088s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:02 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fa94c2e4-f85b-465f-bedb-5c906955b39d tempest-VolumesServicesTestJSON-106773284 None] Lock "cinder-quobyte-06fe2233-8084-461f-9ec4-8755503954b2" released by "delete_volume" :: held 0.794s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:38:03 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-fa94c2e4-f85b-465f-bedb-5c906955b39d tempest-VolumesServicesTestJSON-106773284 None] Created reservations ['a8d5697e-fd2a-4c92-a87f-a81a242bcf2b', 'fda6ec10-89e5-4451-991f-11bc87098039', 'f2914138-ef1c-4d95-98cc-db786a82d6a0', '12e1a034-6876-4193-bf55-6c57772bd0bb'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:38:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fa94c2e4-f85b-465f-bedb-5c906955b39d tempest-VolumesServicesTestJSON-106773284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:38:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fa94c2e4-f85b-465f-bedb-5c906955b39d tempest-VolumesServicesTestJSON-106773284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:38:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fa94c2e4-f85b-465f-bedb-5c906955b39d tempest-VolumesServicesTestJSON-106773284 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:38:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fa94c2e4-f85b-465f-bedb-5c906955b39d tempest-VolumesServicesTestJSON-106773284 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:38:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fa94c2e4-f85b-465f-bedb-5c906955b39d tempest-VolumesServicesTestJSON-106773284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:38:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fa94c2e4-f85b-465f-bedb-5c906955b39d tempest-VolumesServicesTestJSON-106773284 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fa94c2e4-f85b-465f-bedb-5c906955b39d tempest-VolumesServicesTestJSON-106773284 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.094s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:03 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-fa94c2e4-f85b-465f-bedb-5c906955b39d tempest-VolumesServicesTestJSON-106773284 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:38:03 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-fa94c2e4-f85b-465f-bedb-5c906955b39d tempest-VolumesServicesTestJSON-106773284 None] Deleted volume successfully.
Sep 10 11:38:03 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fa94c2e4-f85b-465f-bedb-5c906955b39d tempest-VolumesServicesTestJSON-106773284 None] Lock "cinder-06fe2233-8084-461f-9ec4-8755503954b2-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:38:10 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-e0e1ac4b-a3fd-48bb-90ee-2e441ce04f8e req-24a5c6c6-70a5-4a5a-aa6f-57f165cbbe46 tempest-AttachVolumeTestJSON-901448073 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:38:10 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-e0e1ac4b-a3fd-48bb-90ee-2e441ce04f8e req-24a5c6c6-70a5-4a5a-aa6f-57f165cbbe46 tempest-AttachVolumeTestJSON-901448073 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:38:10 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-e0e1ac4b-a3fd-48bb-90ee-2e441ce04f8e req-24a5c6c6-70a5-4a5a-aa6f-57f165cbbe46 tempest-AttachVolumeTestJSON-901448073 None] Terminate volume connection completed successfully.
Sep 10 11:38:10 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-e0e1ac4b-a3fd-48bb-90ee-2e441ce04f8e req-24a5c6c6-70a5-4a5a-aa6f-57f165cbbe46 tempest-AttachVolumeTestJSON-901448073 None] Deleting attachment c152fbfb-4044-4947-929e-b1fd01b532b0. {{(pid=82594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 11:38:20 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:38:20 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=13,cinder:DELETE=1,cinder:SELECT=8,cinder:INSERT=3 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:38:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:38:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:38:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:38:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:38:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:38:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:38:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.259s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:22 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:38:29 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-139bc4f1-2a11-4871-b9f7-a86afe1e7d65 tempest-AttachVolumeTestJSON-901448073 None] Acquiring lock "cinder-edcb6c0e-8e05-4f85-a022-3785bf39a1c8-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:38:29 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-139bc4f1-2a11-4871-b9f7-a86afe1e7d65 tempest-AttachVolumeTestJSON-901448073 None] Lock "cinder-edcb6c0e-8e05-4f85-a022-3785bf39a1c8-delete_volume" acquired by "delete_volume" :: waited 0.147s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:38:29 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-139bc4f1-2a11-4871-b9f7-a86afe1e7d65 tempest-AttachVolumeTestJSON-901448073 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:38:29 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-139bc4f1-2a11-4871-b9f7-a86afe1e7d65 tempest-AttachVolumeTestJSON-901448073 None] Acquiring lock "cinder-quobyte-edcb6c0e-8e05-4f85-a022-3785bf39a1c8" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:38:29 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-139bc4f1-2a11-4871-b9f7-a86afe1e7d65 tempest-AttachVolumeTestJSON-901448073 None] Lock "cinder-quobyte-edcb6c0e-8e05-4f85-a022-3785bf39a1c8" acquired by "delete_volume" :: waited 0.035s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:38:29 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73f481d-0db6-4e65-a529-4db5c24cf597]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:38:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-139bc4f1-2a11-4871-b9f7-a86afe1e7d65 tempest-AttachVolumeTestJSON-901448073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-edcb6c0e-8e05-4f85-a022-3785bf39a1c8 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-139bc4f1-2a11-4871-b9f7-a86afe1e7d65 tempest-AttachVolumeTestJSON-901448073 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-edcb6c0e-8e05-4f85-a022-3785bf39a1c8" returned: 0 in 1.113s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-139bc4f1-2a11-4871-b9f7-a86afe1e7d65 tempest-AttachVolumeTestJSON-901448073 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-edcb6c0e-8e05-4f85-a022-3785bf39a1c8 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-139bc4f1-2a11-4871-b9f7-a86afe1e7d65 tempest-AttachVolumeTestJSON-901448073 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-edcb6c0e-8e05-4f85-a022-3785bf39a1c8" returned: 0 in 0.285s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:31 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-139bc4f1-2a11-4871-b9f7-a86afe1e7d65 tempest-AttachVolumeTestJSON-901448073 None] Lock "cinder-quobyte-edcb6c0e-8e05-4f85-a022-3785bf39a1c8" released by "delete_volume" :: held 1.697s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:38:32 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-139bc4f1-2a11-4871-b9f7-a86afe1e7d65 tempest-AttachVolumeTestJSON-901448073 None] Created reservations ['71b058ee-8256-4894-a7c0-a8eb78a3ac44', '3e98a192-fbab-4a34-9412-79d2c40d19a9', 'ac0f092e-712a-40e2-9576-a426b0dd5518', '797d60f4-1f3e-41c5-b2fa-c67fbeae8e45'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:38:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-139bc4f1-2a11-4871-b9f7-a86afe1e7d65 tempest-AttachVolumeTestJSON-901448073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:38:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-139bc4f1-2a11-4871-b9f7-a86afe1e7d65 tempest-AttachVolumeTestJSON-901448073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:38:32 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-139bc4f1-2a11-4871-b9f7-a86afe1e7d65 tempest-AttachVolumeTestJSON-901448073 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:38:32 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-139bc4f1-2a11-4871-b9f7-a86afe1e7d65 tempest-AttachVolumeTestJSON-901448073 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:38:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-139bc4f1-2a11-4871-b9f7-a86afe1e7d65 tempest-AttachVolumeTestJSON-901448073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:38:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-139bc4f1-2a11-4871-b9f7-a86afe1e7d65 tempest-AttachVolumeTestJSON-901448073 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-139bc4f1-2a11-4871-b9f7-a86afe1e7d65 tempest-AttachVolumeTestJSON-901448073 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.197s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:32 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-139bc4f1-2a11-4871-b9f7-a86afe1e7d65 tempest-AttachVolumeTestJSON-901448073 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:38:32 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-139bc4f1-2a11-4871-b9f7-a86afe1e7d65 tempest-AttachVolumeTestJSON-901448073 None] Deleted volume successfully.
Sep 10 11:38:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f3b22edb-955e-4ba6-bc78-784659372bdd tempest-AttachVolumeTestJSON-901448073 None] Acquiring lock "cinder-e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:38:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f3b22edb-955e-4ba6-bc78-784659372bdd tempest-AttachVolumeTestJSON-901448073 None] Lock "cinder-e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:38:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-139bc4f1-2a11-4871-b9f7-a86afe1e7d65 tempest-AttachVolumeTestJSON-901448073 None] Lock "cinder-edcb6c0e-8e05-4f85-a022-3785bf39a1c8-delete_volume" released by "delete_volume" :: held 4.274s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:38:33 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-f3b22edb-955e-4ba6-bc78-784659372bdd tempest-AttachVolumeTestJSON-901448073 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:38:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f3b22edb-955e-4ba6-bc78-784659372bdd tempest-AttachVolumeTestJSON-901448073 None] Acquiring lock "cinder-quobyte-e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:38:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f3b22edb-955e-4ba6-bc78-784659372bdd tempest-AttachVolumeTestJSON-901448073 None] Lock "cinder-quobyte-e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08" acquired by "delete_volume" :: waited 0.017s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:38:33 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb82621-4e12-4802-ae0f-2158eff7c6da]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:38:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f3b22edb-955e-4ba6-bc78-784659372bdd tempest-AttachVolumeTestJSON-901448073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f3b22edb-955e-4ba6-bc78-784659372bdd tempest-AttachVolumeTestJSON-901448073 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08" returned: 0 in 0.601s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f3b22edb-955e-4ba6-bc78-784659372bdd tempest-AttachVolumeTestJSON-901448073 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f3b22edb-955e-4ba6-bc78-784659372bdd tempest-AttachVolumeTestJSON-901448073 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08" returned: 0 in 0.119s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:34 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f3b22edb-955e-4ba6-bc78-784659372bdd tempest-AttachVolumeTestJSON-901448073 None] Lock "cinder-quobyte-e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08" released by "delete_volume" :: held 0.898s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:38:35 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-f3b22edb-955e-4ba6-bc78-784659372bdd tempest-AttachVolumeTestJSON-901448073 None] Created reservations ['0a2e8b93-c271-4109-89f1-d144519122b6', '9d08f68f-0967-4685-9f0e-e6a867905c65', '6a018b3a-d9c4-44c4-914c-d1c67d09be53', '473b849f-073d-44dc-8764-718d30f1e2e7'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:38:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f3b22edb-955e-4ba6-bc78-784659372bdd tempest-AttachVolumeTestJSON-901448073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:38:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f3b22edb-955e-4ba6-bc78-784659372bdd tempest-AttachVolumeTestJSON-901448073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:38:35 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f3b22edb-955e-4ba6-bc78-784659372bdd tempest-AttachVolumeTestJSON-901448073 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:38:35 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f3b22edb-955e-4ba6-bc78-784659372bdd tempest-AttachVolumeTestJSON-901448073 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:38:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f3b22edb-955e-4ba6-bc78-784659372bdd tempest-AttachVolumeTestJSON-901448073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:38:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f3b22edb-955e-4ba6-bc78-784659372bdd tempest-AttachVolumeTestJSON-901448073 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f3b22edb-955e-4ba6-bc78-784659372bdd tempest-AttachVolumeTestJSON-901448073 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.453s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:35 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-f3b22edb-955e-4ba6-bc78-784659372bdd tempest-AttachVolumeTestJSON-901448073 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:38:35 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-f3b22edb-955e-4ba6-bc78-784659372bdd tempest-AttachVolumeTestJSON-901448073 None] Deleted volume successfully.
Sep 10 11:38:36 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f3b22edb-955e-4ba6-bc78-784659372bdd tempest-AttachVolumeTestJSON-901448073 None] Lock "cinder-e697bb0b-e59f-4e3e-9a99-5a02bb6a8f08-delete_volume" released by "delete_volume" :: held 2.689s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:38:36 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-eec5f0fd-93b0-4b5c-a0d2-cad74e476e5c tempest-AttachVolumeTestJSON-901448073 None] Acquiring lock "cinder-6b8d08b8-0017-496b-90af-cbbe695f8396-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:38:36 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-eec5f0fd-93b0-4b5c-a0d2-cad74e476e5c tempest-AttachVolumeTestJSON-901448073 None] Lock "cinder-6b8d08b8-0017-496b-90af-cbbe695f8396-delete_volume" acquired by "delete_volume" :: waited 0.179s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:38:37 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-eec5f0fd-93b0-4b5c-a0d2-cad74e476e5c tempest-AttachVolumeTestJSON-901448073 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:38:37 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-eec5f0fd-93b0-4b5c-a0d2-cad74e476e5c tempest-AttachVolumeTestJSON-901448073 None] Acquiring lock "cinder-quobyte-6b8d08b8-0017-496b-90af-cbbe695f8396" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:38:37 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-eec5f0fd-93b0-4b5c-a0d2-cad74e476e5c tempest-AttachVolumeTestJSON-901448073 None] Lock "cinder-quobyte-6b8d08b8-0017-496b-90af-cbbe695f8396" acquired by "delete_volume" :: waited 0.013s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:38:37 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c823815-e1f0-4ea2-ba0a-03b036efa5f2]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:38:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-eec5f0fd-93b0-4b5c-a0d2-cad74e476e5c tempest-AttachVolumeTestJSON-901448073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6b8d08b8-0017-496b-90af-cbbe695f8396 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-eec5f0fd-93b0-4b5c-a0d2-cad74e476e5c tempest-AttachVolumeTestJSON-901448073 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6b8d08b8-0017-496b-90af-cbbe695f8396" returned: 0 in 0.912s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-eec5f0fd-93b0-4b5c-a0d2-cad74e476e5c tempest-AttachVolumeTestJSON-901448073 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6b8d08b8-0017-496b-90af-cbbe695f8396 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-eec5f0fd-93b0-4b5c-a0d2-cad74e476e5c tempest-AttachVolumeTestJSON-901448073 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6b8d08b8-0017-496b-90af-cbbe695f8396" returned: 0 in 0.150s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:38 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-eec5f0fd-93b0-4b5c-a0d2-cad74e476e5c tempest-AttachVolumeTestJSON-901448073 None] Lock "cinder-quobyte-6b8d08b8-0017-496b-90af-cbbe695f8396" released by "delete_volume" :: held 1.331s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:38:38 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-eec5f0fd-93b0-4b5c-a0d2-cad74e476e5c tempest-AttachVolumeTestJSON-901448073 None] Created reservations ['11cf9a6c-d48a-49bd-b330-d768897ae697', 'cc09439b-e606-4993-a608-df9ae8f77f25', 'df83b8cb-24d4-4e3c-8475-74a75e4fbc11', 'c7c38cdf-95d3-482f-a38f-b818262a9faf'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:38:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-eec5f0fd-93b0-4b5c-a0d2-cad74e476e5c tempest-AttachVolumeTestJSON-901448073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:38:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-eec5f0fd-93b0-4b5c-a0d2-cad74e476e5c tempest-AttachVolumeTestJSON-901448073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:38:38 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-eec5f0fd-93b0-4b5c-a0d2-cad74e476e5c tempest-AttachVolumeTestJSON-901448073 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:38:38 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-eec5f0fd-93b0-4b5c-a0d2-cad74e476e5c tempest-AttachVolumeTestJSON-901448073 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:38:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-eec5f0fd-93b0-4b5c-a0d2-cad74e476e5c tempest-AttachVolumeTestJSON-901448073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:38:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-eec5f0fd-93b0-4b5c-a0d2-cad74e476e5c tempest-AttachVolumeTestJSON-901448073 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-eec5f0fd-93b0-4b5c-a0d2-cad74e476e5c tempest-AttachVolumeTestJSON-901448073 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.253s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:39 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-eec5f0fd-93b0-4b5c-a0d2-cad74e476e5c tempest-AttachVolumeTestJSON-901448073 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:38:39 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-eec5f0fd-93b0-4b5c-a0d2-cad74e476e5c tempest-AttachVolumeTestJSON-901448073 None] Deleted volume successfully.
Sep 10 11:38:39 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-eec5f0fd-93b0-4b5c-a0d2-cad74e476e5c tempest-AttachVolumeTestJSON-901448073 None] Lock "cinder-6b8d08b8-0017-496b-90af-cbbe695f8396-delete_volume" released by "delete_volume" :: held 3.161s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:38:44 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:38:44 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:38:44 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Flow 'volume_create_manager' (d7617ef5-9f72-493b-9782-9d0b68520b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:38:44 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85835fb-12a7-401d-8d47-8e5f8a2e5dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:38:44 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85835fb-12a7-401d-8d47-8e5f8a2e5dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-570186802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7cf451-3669-454b-8a97-5792167e079f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d49fe3c17ad649d6927d92166ff9b371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:38:44Z,use_quota=True,user_id='32adc64d05a1414bb1ec9bb3d6ec0f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:38:44 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c270d8-642b-445c-8f8a-f584951ceec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:38:44 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c270d8-642b-445c-8f8a-f584951ceec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:38:44 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0feb57-b8f7-4ec7-9c53-d6f4c30a77df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:38:44 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0feb57-b8f7-4ec7-9c53-d6f4c30a77df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a7cf451-3669-454b-8a97-5792167e079f', 'volume_name': 'volume-7a7cf451-3669-454b-8a97-5792167e079f', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:38:44 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e44f9ee-e191-43a6-8cd7-014d5dabbffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:38:44 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e44f9ee-e191-43a6-8cd7-014d5dabbffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:38:44 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc11f21-e63d-4a6e-9876-95c532b43624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:38:44 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Volume 7a7cf451-3669-454b-8a97-5792167e079f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a7cf451-3669-454b-8a97-5792167e079f', 'volume_size': 1}
Sep 10 11:38:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:38:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:38:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-570186802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7cf451-3669-454b-8a97-5792167e079f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d49fe3c17ad649d6927d92166ff9b371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:38:44Z,use_quota=True,user_id='32adc64d05a1414bb1ec9bb3d6ec0f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:38:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Creating volume 7a7cf451-3669-454b-8a97-5792167e079f {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:38:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:38:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:38:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:38:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:38:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:38:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:38:44 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:38:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7a7cf451-3669-454b-8a97-5792167e079f 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:44 devstack quobyte-client[82616]: System call of process 89651 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:38:44 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=30, name=volume-7a7cf451-3669-454b-8a97-5792167e079f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:38:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7a7cf451-3669-454b-8a97-5792167e079f 1073741824" returned: 0 in 0.479s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7a7cf451-3669-454b-8a97-5792167e079f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7a7cf451-3669-454b-8a97-5792167e079f" returned: 0 in 0.275s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:45 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] <== create_volume: return (869ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:38:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:38:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc11f21-e63d-4a6e-9876-95c532b43624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a7cf451-3669-454b-8a97-5792167e079f', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:38:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17959827-8c55-4fec-a0a7-ca6b4c6f3d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:38:45 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Volume volume-7a7cf451-3669-454b-8a97-5792167e079f (7a7cf451-3669-454b-8a97-5792167e079f): created successfully
Sep 10 11:38:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17959827-8c55-4fec-a0a7-ca6b4c6f3d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:38:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Flow 'volume_create_manager' (d7617ef5-9f72-493b-9782-9d0b68520b06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:38:45 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-4f4377d5-1e03-4511-bd58-9b8f4b033c9b tempest-VolumesListAdminTestJSON-1411465950 None] Created volume successfully.
Sep 10 11:38:47 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:38:47 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:38:47 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Flow 'volume_create_manager' (d826e0bc-6a29-4c68-a8dc-6889fc2b26da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:38:47 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4fece7f-4e03-4526-8fe9-741bcdb4cf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:38:47 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4fece7f-4e03-4526-8fe9-741bcdb4cf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1890215322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c35d63de-989c-4c73-b3da-41fc1481f6a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d49fe3c17ad649d6927d92166ff9b371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:38:47Z,use_quota=True,user_id='32adc64d05a1414bb1ec9bb3d6ec0f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:38:47 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1cfd41b-0295-4ce7-b53b-3beceda655a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:38:47 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1cfd41b-0295-4ce7-b53b-3beceda655a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:38:47 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (300d21ac-e3f7-442a-87da-0db0765297a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:38:47 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (300d21ac-e3f7-442a-87da-0db0765297a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c35d63de-989c-4c73-b3da-41fc1481f6a9', 'volume_name': 'volume-c35d63de-989c-4c73-b3da-41fc1481f6a9', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:38:47 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b0f2db-d581-4c07-ac40-28b6ff73defe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:38:47 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b0f2db-d581-4c07-ac40-28b6ff73defe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:38:47 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41786e35-c74d-4b5b-8bdc-c9cdfc17d0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:38:47 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Volume c35d63de-989c-4c73-b3da-41fc1481f6a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c35d63de-989c-4c73-b3da-41fc1481f6a9', 'volume_size': 1}
Sep 10 11:38:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:38:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:38:47 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1890215322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c35d63de-989c-4c73-b3da-41fc1481f6a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d49fe3c17ad649d6927d92166ff9b371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:38:47Z,use_quota=True,user_id='32adc64d05a1414bb1ec9bb3d6ec0f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:38:47 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Creating volume c35d63de-989c-4c73-b3da-41fc1481f6a9 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:38:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:38:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:38:47 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:38:47 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:38:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:38:47 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:38:47 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:38:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c35d63de-989c-4c73-b3da-41fc1481f6a9 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:47 devstack quobyte-client[82616]: System call of process 89670 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:38:48 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=31, name=volume-c35d63de-989c-4c73-b3da-41fc1481f6a9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:38:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c35d63de-989c-4c73-b3da-41fc1481f6a9 1073741824" returned: 0 in 0.495s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c35d63de-989c-4c73-b3da-41fc1481f6a9 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c35d63de-989c-4c73-b3da-41fc1481f6a9" returned: 0 in 0.275s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:48 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] <== create_volume: return (908ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:38:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:38:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41786e35-c74d-4b5b-8bdc-c9cdfc17d0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c35d63de-989c-4c73-b3da-41fc1481f6a9', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:38:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5015f8d1-46ce-4311-aef1-ae81799c6592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:38:49 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Volume volume-c35d63de-989c-4c73-b3da-41fc1481f6a9 (c35d63de-989c-4c73-b3da-41fc1481f6a9): created successfully
Sep 10 11:38:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5015f8d1-46ce-4311-aef1-ae81799c6592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:38:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Flow 'volume_create_manager' (d826e0bc-6a29-4c68-a8dc-6889fc2b26da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:38:49 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-d9d8b6d3-64cc-41bf-a38a-78e6fb396e71 tempest-VolumesListAdminTestJSON-1411465950 None] Created volume successfully.
Sep 10 11:38:50 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:38:50 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:38:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Flow 'volume_create_manager' (893d8ee8-f38f-4ea2-ae18-00a64ff7354f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:38:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (758a7323-77af-40ff-8b1b-7a923944fde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:38:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (758a7323-77af-40ff-8b1b-7a923944fde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-339969926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f9d8264-73c2-4bba-8293-8a484005d596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d49fe3c17ad649d6927d92166ff9b371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:38:51Z,use_quota=True,user_id='32adc64d05a1414bb1ec9bb3d6ec0f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:38:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a3ecac-298d-432a-b425-d28d9f2b56fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:38:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a3ecac-298d-432a-b425-d28d9f2b56fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:38:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95894079-5722-471e-bc06-29618b484fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:38:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95894079-5722-471e-bc06-29618b484fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f9d8264-73c2-4bba-8293-8a484005d596', 'volume_name': 'volume-8f9d8264-73c2-4bba-8293-8a484005d596', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:38:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4bbd274-cdb9-4fbd-932e-d4f62d1b6591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:38:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4bbd274-cdb9-4fbd-932e-d4f62d1b6591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:38:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06bf132-c8ff-4e57-8626-9db58b17a6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:38:50 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Volume 8f9d8264-73c2-4bba-8293-8a484005d596: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f9d8264-73c2-4bba-8293-8a484005d596', 'volume_size': 1}
Sep 10 11:38:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:38:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:38:50 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-339969926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f9d8264-73c2-4bba-8293-8a484005d596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d49fe3c17ad649d6927d92166ff9b371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:38:51Z,use_quota=True,user_id='32adc64d05a1414bb1ec9bb3d6ec0f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:38:50 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Creating volume 8f9d8264-73c2-4bba-8293-8a484005d596 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:38:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:38:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:38:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:38:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:38:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:38:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:38:51 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:38:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8f9d8264-73c2-4bba-8293-8a484005d596 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:51 devstack quobyte-client[82616]: System call of process 89675 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:38:51 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=32, name=volume-8f9d8264-73c2-4bba-8293-8a484005d596, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:38:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8f9d8264-73c2-4bba-8293-8a484005d596 1073741824" returned: 0 in 0.435s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8f9d8264-73c2-4bba-8293-8a484005d596 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8f9d8264-73c2-4bba-8293-8a484005d596" returned: 0 in 0.215s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] <== create_volume: return (741ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:38:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:38:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06bf132-c8ff-4e57-8626-9db58b17a6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f9d8264-73c2-4bba-8293-8a484005d596', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:38:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316cd9f9-e541-4b43-b187-bb33858cb2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:38:52 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Volume volume-8f9d8264-73c2-4bba-8293-8a484005d596 (8f9d8264-73c2-4bba-8293-8a484005d596): created successfully
Sep 10 11:38:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316cd9f9-e541-4b43-b187-bb33858cb2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:38:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Flow 'volume_create_manager' (893d8ee8-f38f-4ea2-ae18-00a64ff7354f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:38:52 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-3b23de9e-74d4-4404-b4f5-ca7145bf2c0d tempest-VolumesListAdminTestJSON-1411465950 None] Created volume successfully.
Sep 10 11:38:54 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:38:54 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:38:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Flow 'volume_create_manager' (705b3c98-f643-472e-9609-c3e343fd17f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:38:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a2e661-6729-4e87-bdd7-6cbeb34c6cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:38:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a2e661-6729-4e87-bdd7-6cbeb34c6cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f4dd6ce-f990-484d-aa19-7026a6ad9d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db597ff9196421bbce7d441827d08a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:38:54Z,use_quota=True,user_id='7a9879d5f5934a41840ad0cac525538c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:38:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff57ae4-2d3c-4404-a5c0-f246313861c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:38:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff57ae4-2d3c-4404-a5c0-f246313861c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:38:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d079a1a9-9aa2-4cdd-931d-5e1d722ab37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:38:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d079a1a9-9aa2-4cdd-931d-5e1d722ab37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f4dd6ce-f990-484d-aa19-7026a6ad9d84', 'volume_name': 'volume-3f4dd6ce-f990-484d-aa19-7026a6ad9d84', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:38:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a5fc0a-853f-4d6b-987a-332cd4b4fe49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:38:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a5fc0a-853f-4d6b-987a-332cd4b4fe49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:38:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b8af051-2c13-4da5-a224-a86622d647f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:38:54 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Volume 3f4dd6ce-f990-484d-aa19-7026a6ad9d84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f4dd6ce-f990-484d-aa19-7026a6ad9d84', 'volume_size': 1}
Sep 10 11:38:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:38:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:38:54 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f4dd6ce-f990-484d-aa19-7026a6ad9d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db597ff9196421bbce7d441827d08a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:38:54Z,use_quota=True,user_id='7a9879d5f5934a41840ad0cac525538c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:38:54 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Creating volume 3f4dd6ce-f990-484d-aa19-7026a6ad9d84 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:38:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:38:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:38:54 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:38:54 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:38:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:38:54 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:38:54 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:38:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3f4dd6ce-f990-484d-aa19-7026a6ad9d84 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:54 devstack quobyte-client[82616]: System call of process 89679 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:38:54 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=33, name=volume-3f4dd6ce-f990-484d-aa19-7026a6ad9d84, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:38:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3f4dd6ce-f990-484d-aa19-7026a6ad9d84 1073741824" returned: 0 in 0.594s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3f4dd6ce-f990-484d-aa19-7026a6ad9d84 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3f4dd6ce-f990-484d-aa19-7026a6ad9d84" returned: 0 in 0.163s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:55 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] <== create_volume: return (890ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:38:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:38:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b8af051-2c13-4da5-a224-a86622d647f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f4dd6ce-f990-484d-aa19-7026a6ad9d84', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:38:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983b044b-6583-4ec8-8ca8-a03799e3ffc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:38:55 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Volume volume-3f4dd6ce-f990-484d-aa19-7026a6ad9d84 (3f4dd6ce-f990-484d-aa19-7026a6ad9d84): created successfully
Sep 10 11:38:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983b044b-6583-4ec8-8ca8-a03799e3ffc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:38:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Flow 'volume_create_manager' (705b3c98-f643-472e-9609-c3e343fd17f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:38:55 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-10594a94-94d4-4841-97be-de470f319a23 tempest-VolumesListAdminTestJSON-1121851397 None] Created volume successfully.
Sep 10 11:38:56 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f44c1615-a331-437f-bc8c-2b5d11125a49 tempest-VolumesListAdminTestJSON-1121851397 None] Acquiring lock "cinder-3f4dd6ce-f990-484d-aa19-7026a6ad9d84-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:38:56 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f44c1615-a331-437f-bc8c-2b5d11125a49 tempest-VolumesListAdminTestJSON-1121851397 None] Lock "cinder-3f4dd6ce-f990-484d-aa19-7026a6ad9d84-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:38:57 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-f44c1615-a331-437f-bc8c-2b5d11125a49 tempest-VolumesListAdminTestJSON-1121851397 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:38:57 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f44c1615-a331-437f-bc8c-2b5d11125a49 tempest-VolumesListAdminTestJSON-1121851397 None] Acquiring lock "cinder-quobyte-3f4dd6ce-f990-484d-aa19-7026a6ad9d84" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:38:57 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bc8cd6de-9136-4038-ab8e-33645f6b4865 tempest-VolumesListAdminTestJSON-1411465950 None] Acquiring lock "cinder-8f9d8264-73c2-4bba-8293-8a484005d596-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:38:57 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f44c1615-a331-437f-bc8c-2b5d11125a49 tempest-VolumesListAdminTestJSON-1121851397 None] Lock "cinder-quobyte-3f4dd6ce-f990-484d-aa19-7026a6ad9d84" acquired by "delete_volume" :: waited 0.105s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:38:57 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bc8cd6de-9136-4038-ab8e-33645f6b4865 tempest-VolumesListAdminTestJSON-1411465950 None] Lock "cinder-8f9d8264-73c2-4bba-8293-8a484005d596-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:38:57 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8cb206-32ba-4b82-b4b2-15db9722a392]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:38:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f44c1615-a331-437f-bc8c-2b5d11125a49 tempest-VolumesListAdminTestJSON-1121851397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3f4dd6ce-f990-484d-aa19-7026a6ad9d84 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:57 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-bc8cd6de-9136-4038-ab8e-33645f6b4865 tempest-VolumesListAdminTestJSON-1411465950 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:38:57 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bc8cd6de-9136-4038-ab8e-33645f6b4865 tempest-VolumesListAdminTestJSON-1411465950 None] Acquiring lock "cinder-quobyte-8f9d8264-73c2-4bba-8293-8a484005d596" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:38:57 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bc8cd6de-9136-4038-ab8e-33645f6b4865 tempest-VolumesListAdminTestJSON-1411465950 None] Lock "cinder-quobyte-8f9d8264-73c2-4bba-8293-8a484005d596" acquired by "delete_volume" :: waited 0.106s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:38:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f44c1615-a331-437f-bc8c-2b5d11125a49 tempest-VolumesListAdminTestJSON-1121851397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3f4dd6ce-f990-484d-aa19-7026a6ad9d84" returned: 0 in 0.581s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f44c1615-a331-437f-bc8c-2b5d11125a49 tempest-VolumesListAdminTestJSON-1121851397 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3f4dd6ce-f990-484d-aa19-7026a6ad9d84 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:57 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca56d0b5-f931-405e-a1fb-dd0247d933ab]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:38:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bc8cd6de-9136-4038-ab8e-33645f6b4865 tempest-VolumesListAdminTestJSON-1411465950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8f9d8264-73c2-4bba-8293-8a484005d596 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f44c1615-a331-437f-bc8c-2b5d11125a49 tempest-VolumesListAdminTestJSON-1121851397 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3f4dd6ce-f990-484d-aa19-7026a6ad9d84" returned: 0 in 0.206s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:58 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f44c1615-a331-437f-bc8c-2b5d11125a49 tempest-VolumesListAdminTestJSON-1121851397 None] Lock "cinder-quobyte-3f4dd6ce-f990-484d-aa19-7026a6ad9d84" released by "delete_volume" :: held 1.052s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:38:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bc8cd6de-9136-4038-ab8e-33645f6b4865 tempest-VolumesListAdminTestJSON-1411465950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8f9d8264-73c2-4bba-8293-8a484005d596" returned: 0 in 0.664s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bc8cd6de-9136-4038-ab8e-33645f6b4865 tempest-VolumesListAdminTestJSON-1411465950 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8f9d8264-73c2-4bba-8293-8a484005d596 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:58 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-f44c1615-a331-437f-bc8c-2b5d11125a49 tempest-VolumesListAdminTestJSON-1121851397 None] Created reservations ['c36bfd1c-3aed-4df4-ae9b-6315bdb38105', 'e40f4dce-7c4a-4b8c-8f2f-9bfabc9aec32', 'b672e2fa-74bb-42c8-8f88-f518ceae8bfa', 'c9d1316e-3c26-406f-a429-33adf5188df9'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:38:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bc8cd6de-9136-4038-ab8e-33645f6b4865 tempest-VolumesListAdminTestJSON-1411465950 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8f9d8264-73c2-4bba-8293-8a484005d596" returned: 0 in 0.377s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:59 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bc8cd6de-9136-4038-ab8e-33645f6b4865 tempest-VolumesListAdminTestJSON-1411465950 None] Lock "cinder-quobyte-8f9d8264-73c2-4bba-8293-8a484005d596" released by "delete_volume" :: held 1.321s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:38:59 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-bc8cd6de-9136-4038-ab8e-33645f6b4865 tempest-VolumesListAdminTestJSON-1411465950 None] Created reservations ['a0f4916c-36d4-4810-a2c9-c1765517eb28', 'f826acc7-f3f4-404f-b915-f72f8f057da9', '25b5527a-11f3-4cb9-a0a5-d80f650adfc2', '791777d5-31c5-406c-bd4a-6bb58ef9fc30'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:38:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f44c1615-a331-437f-bc8c-2b5d11125a49 tempest-VolumesListAdminTestJSON-1121851397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:38:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f44c1615-a331-437f-bc8c-2b5d11125a49 tempest-VolumesListAdminTestJSON-1121851397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:38:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f44c1615-a331-437f-bc8c-2b5d11125a49 tempest-VolumesListAdminTestJSON-1121851397 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:38:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f44c1615-a331-437f-bc8c-2b5d11125a49 tempest-VolumesListAdminTestJSON-1121851397 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:38:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f44c1615-a331-437f-bc8c-2b5d11125a49 tempest-VolumesListAdminTestJSON-1121851397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:38:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f44c1615-a331-437f-bc8c-2b5d11125a49 tempest-VolumesListAdminTestJSON-1121851397 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:38:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f44c1615-a331-437f-bc8c-2b5d11125a49 tempest-VolumesListAdminTestJSON-1121851397 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.284s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:38:59 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-f44c1615-a331-437f-bc8c-2b5d11125a49 tempest-VolumesListAdminTestJSON-1121851397 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:38:59 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-f44c1615-a331-437f-bc8c-2b5d11125a49 tempest-VolumesListAdminTestJSON-1121851397 None] Deleted volume successfully.
Sep 10 11:38:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bc8cd6de-9136-4038-ab8e-33645f6b4865 tempest-VolumesListAdminTestJSON-1411465950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:38:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bc8cd6de-9136-4038-ab8e-33645f6b4865 tempest-VolumesListAdminTestJSON-1411465950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:38:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bc8cd6de-9136-4038-ab8e-33645f6b4865 tempest-VolumesListAdminTestJSON-1411465950 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:38:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bc8cd6de-9136-4038-ab8e-33645f6b4865 tempest-VolumesListAdminTestJSON-1411465950 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:38:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bc8cd6de-9136-4038-ab8e-33645f6b4865 tempest-VolumesListAdminTestJSON-1411465950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:38:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bc8cd6de-9136-4038-ab8e-33645f6b4865 tempest-VolumesListAdminTestJSON-1411465950 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:00 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f44c1615-a331-437f-bc8c-2b5d11125a49 tempest-VolumesListAdminTestJSON-1121851397 None] Lock "cinder-3f4dd6ce-f990-484d-aa19-7026a6ad9d84-delete_volume" released by "delete_volume" :: held 3.188s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:39:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bc8cd6de-9136-4038-ab8e-33645f6b4865 tempest-VolumesListAdminTestJSON-1411465950 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.189s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:00 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bc8cd6de-9136-4038-ab8e-33645f6b4865 tempest-VolumesListAdminTestJSON-1411465950 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:39:00 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-bc8cd6de-9136-4038-ab8e-33645f6b4865 tempest-VolumesListAdminTestJSON-1411465950 None] Deleted volume successfully.
Sep 10 11:39:00 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bc8cd6de-9136-4038-ab8e-33645f6b4865 tempest-VolumesListAdminTestJSON-1411465950 None] Lock "cinder-8f9d8264-73c2-4bba-8293-8a484005d596-delete_volume" released by "delete_volume" :: held 3.080s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:39:00 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-458be2c5-93c2-42c1-b5d9-95b4a8677718 tempest-VolumesListAdminTestJSON-1411465950 None] Acquiring lock "cinder-c35d63de-989c-4c73-b3da-41fc1481f6a9-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:39:00 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-458be2c5-93c2-42c1-b5d9-95b4a8677718 tempest-VolumesListAdminTestJSON-1411465950 None] Lock "cinder-c35d63de-989c-4c73-b3da-41fc1481f6a9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:39:01 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-458be2c5-93c2-42c1-b5d9-95b4a8677718 tempest-VolumesListAdminTestJSON-1411465950 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:39:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-458be2c5-93c2-42c1-b5d9-95b4a8677718 tempest-VolumesListAdminTestJSON-1411465950 None] Acquiring lock "cinder-quobyte-c35d63de-989c-4c73-b3da-41fc1481f6a9" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:39:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-458be2c5-93c2-42c1-b5d9-95b4a8677718 tempest-VolumesListAdminTestJSON-1411465950 None] Lock "cinder-quobyte-c35d63de-989c-4c73-b3da-41fc1481f6a9" acquired by "delete_volume" :: waited 0.027s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:39:01 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d71826-b92c-4bbd-8ea9-349b6969c92f]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:39:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-458be2c5-93c2-42c1-b5d9-95b4a8677718 tempest-VolumesListAdminTestJSON-1411465950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c35d63de-989c-4c73-b3da-41fc1481f6a9 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-458be2c5-93c2-42c1-b5d9-95b4a8677718 tempest-VolumesListAdminTestJSON-1411465950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c35d63de-989c-4c73-b3da-41fc1481f6a9" returned: 0 in 0.551s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-458be2c5-93c2-42c1-b5d9-95b4a8677718 tempest-VolumesListAdminTestJSON-1411465950 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c35d63de-989c-4c73-b3da-41fc1481f6a9 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-458be2c5-93c2-42c1-b5d9-95b4a8677718 tempest-VolumesListAdminTestJSON-1411465950 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c35d63de-989c-4c73-b3da-41fc1481f6a9" returned: 0 in 0.109s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-458be2c5-93c2-42c1-b5d9-95b4a8677718 tempest-VolumesListAdminTestJSON-1411465950 None] Lock "cinder-quobyte-c35d63de-989c-4c73-b3da-41fc1481f6a9" released by "delete_volume" :: held 0.834s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:39:02 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-458be2c5-93c2-42c1-b5d9-95b4a8677718 tempest-VolumesListAdminTestJSON-1411465950 None] Created reservations ['14ec32b1-b892-4590-82df-59724d6a7aca', '804c7b7e-96cf-464e-9db1-59160841f6b3', 'b18d5aeb-f903-429d-8342-47956a8848d6', 'cacb1f10-1518-45e9-91e2-ce4228602c99'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:39:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-458be2c5-93c2-42c1-b5d9-95b4a8677718 tempest-VolumesListAdminTestJSON-1411465950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:39:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-458be2c5-93c2-42c1-b5d9-95b4a8677718 tempest-VolumesListAdminTestJSON-1411465950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:39:02 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-458be2c5-93c2-42c1-b5d9-95b4a8677718 tempest-VolumesListAdminTestJSON-1411465950 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:39:02 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-458be2c5-93c2-42c1-b5d9-95b4a8677718 tempest-VolumesListAdminTestJSON-1411465950 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:39:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-458be2c5-93c2-42c1-b5d9-95b4a8677718 tempest-VolumesListAdminTestJSON-1411465950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:39:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-458be2c5-93c2-42c1-b5d9-95b4a8677718 tempest-VolumesListAdminTestJSON-1411465950 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-458be2c5-93c2-42c1-b5d9-95b4a8677718 tempest-VolumesListAdminTestJSON-1411465950 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.136s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:02 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-458be2c5-93c2-42c1-b5d9-95b4a8677718 tempest-VolumesListAdminTestJSON-1411465950 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:39:02 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-458be2c5-93c2-42c1-b5d9-95b4a8677718 tempest-VolumesListAdminTestJSON-1411465950 None] Deleted volume successfully.
Sep 10 11:39:02 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-458be2c5-93c2-42c1-b5d9-95b4a8677718 tempest-VolumesListAdminTestJSON-1411465950 None] Lock "cinder-c35d63de-989c-4c73-b3da-41fc1481f6a9-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:39:03 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-77ec1392-fc55-47c2-9f47-08f21012bdb6 tempest-VolumesListAdminTestJSON-1411465950 None] Acquiring lock "cinder-7a7cf451-3669-454b-8a97-5792167e079f-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:39:03 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-77ec1392-fc55-47c2-9f47-08f21012bdb6 tempest-VolumesListAdminTestJSON-1411465950 None] Lock "cinder-7a7cf451-3669-454b-8a97-5792167e079f-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:39:03 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-77ec1392-fc55-47c2-9f47-08f21012bdb6 tempest-VolumesListAdminTestJSON-1411465950 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:39:03 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-77ec1392-fc55-47c2-9f47-08f21012bdb6 tempest-VolumesListAdminTestJSON-1411465950 None] Acquiring lock "cinder-quobyte-7a7cf451-3669-454b-8a97-5792167e079f" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:39:03 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-77ec1392-fc55-47c2-9f47-08f21012bdb6 tempest-VolumesListAdminTestJSON-1411465950 None] Lock "cinder-quobyte-7a7cf451-3669-454b-8a97-5792167e079f" acquired by "delete_volume" :: waited 0.019s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:39:03 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9808f2e-3866-4612-8372-cec7d160a187]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:39:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-77ec1392-fc55-47c2-9f47-08f21012bdb6 tempest-VolumesListAdminTestJSON-1411465950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7a7cf451-3669-454b-8a97-5792167e079f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:04 devstack quobyte-client[82616]: System call of process 89701 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:39:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-77ec1392-fc55-47c2-9f47-08f21012bdb6 tempest-VolumesListAdminTestJSON-1411465950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7a7cf451-3669-454b-8a97-5792167e079f" returned: 0 in 0.569s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-77ec1392-fc55-47c2-9f47-08f21012bdb6 tempest-VolumesListAdminTestJSON-1411465950 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7a7cf451-3669-454b-8a97-5792167e079f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-77ec1392-fc55-47c2-9f47-08f21012bdb6 tempest-VolumesListAdminTestJSON-1411465950 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7a7cf451-3669-454b-8a97-5792167e079f" returned: 0 in 0.232s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:04 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-77ec1392-fc55-47c2-9f47-08f21012bdb6 tempest-VolumesListAdminTestJSON-1411465950 None] Lock "cinder-quobyte-7a7cf451-3669-454b-8a97-5792167e079f" released by "delete_volume" :: held 1.231s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:39:05 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-77ec1392-fc55-47c2-9f47-08f21012bdb6 tempest-VolumesListAdminTestJSON-1411465950 None] Created reservations ['da1f2da6-8454-458e-b437-a9118d0848b4', 'd79de637-1786-44cf-92ec-183c8be18fbb', 'ab43d078-f027-4b0b-bee7-90e54ea3459c', '83e742f5-ac52-41cf-a315-85aaab303e79'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:39:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-77ec1392-fc55-47c2-9f47-08f21012bdb6 tempest-VolumesListAdminTestJSON-1411465950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:39:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-77ec1392-fc55-47c2-9f47-08f21012bdb6 tempest-VolumesListAdminTestJSON-1411465950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:39:05 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-77ec1392-fc55-47c2-9f47-08f21012bdb6 tempest-VolumesListAdminTestJSON-1411465950 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:39:05 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-77ec1392-fc55-47c2-9f47-08f21012bdb6 tempest-VolumesListAdminTestJSON-1411465950 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:39:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-77ec1392-fc55-47c2-9f47-08f21012bdb6 tempest-VolumesListAdminTestJSON-1411465950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:39:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-77ec1392-fc55-47c2-9f47-08f21012bdb6 tempest-VolumesListAdminTestJSON-1411465950 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-77ec1392-fc55-47c2-9f47-08f21012bdb6 tempest-VolumesListAdminTestJSON-1411465950 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.521s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:06 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-77ec1392-fc55-47c2-9f47-08f21012bdb6 tempest-VolumesListAdminTestJSON-1411465950 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:39:06 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-77ec1392-fc55-47c2-9f47-08f21012bdb6 tempest-VolumesListAdminTestJSON-1411465950 None] Deleted volume successfully.
Sep 10 11:39:06 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-77ec1392-fc55-47c2-9f47-08f21012bdb6 tempest-VolumesListAdminTestJSON-1411465950 None] Lock "cinder-7a7cf451-3669-454b-8a97-5792167e079f-delete_volume" released by "delete_volume" :: held 3.123s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:39:15 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=64,cinder:SELECT=39,cinder:INSERT=13,cinder:DELETE=6 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:39:16 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=39,cinder:INSERT=15,cinder:UPDATE=64,cinder:DELETE=5 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:39:19 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:39:19 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:39:19 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Flow 'volume_create_manager' (bc74bf23-5e0d-47cb-abc3-509ced66fec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:39:19 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9054b5e-aa25-445f-9d2f-ee1387546491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:39:19 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9054b5e-aa25-445f-9d2f-ee1387546491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1485904123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f10930-151a-4cb9-869d-9c8fdb0e5ecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a43fc81a4faf4a42a64fe0d64932ab08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:39:19Z,use_quota=True,user_id='4f9da246b72445a1b85cccb43d30e871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:39:19 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a30223-0638-4dcb-ba91-10f4e7d59a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:39:19 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a30223-0638-4dcb-ba91-10f4e7d59a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:39:19 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3bcc3e9-f4bf-4014-a7f1-28e02e1ee936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:39:19 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3bcc3e9-f4bf-4014-a7f1-28e02e1ee936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29f10930-151a-4cb9-869d-9c8fdb0e5ecc', 'volume_name': 'volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:39:19 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c75f26-8075-4d28-843c-d5165ccbad01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:39:19 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c75f26-8075-4d28-843c-d5165ccbad01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:39:19 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31183506-86c4-49d9-8772-5fd106f8d716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:39:19 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Volume 29f10930-151a-4cb9-869d-9c8fdb0e5ecc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc', 'volume_size': 1}
Sep 10 11:39:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:39:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:39:19 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1485904123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f10930-151a-4cb9-869d-9c8fdb0e5ecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a43fc81a4faf4a42a64fe0d64932ab08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:39:19Z,use_quota=True,user_id='4f9da246b72445a1b85cccb43d30e871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:39:19 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Creating volume 29f10930-151a-4cb9-869d-9c8fdb0e5ecc {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:39:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:39:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:39:19 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:39:19 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:39:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:39:19 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:39:19 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:39:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:19 devstack quobyte-client[82616]: System call of process 89731 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:39:19 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=34, name=volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:39:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc 1073741824" returned: 0 in 0.436s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc" returned: 0 in 0.195s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:20 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] <== create_volume: return (748ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:39:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:39:20 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31183506-86c4-49d9-8772-5fd106f8d716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:39:20 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9eda410-8850-4e34-ad81-88ff73d9b69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:39:20 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Volume volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc (29f10930-151a-4cb9-869d-9c8fdb0e5ecc): created successfully
Sep 10 11:39:20 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9eda410-8850-4e34-ad81-88ff73d9b69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:39:20 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Flow 'volume_create_manager' (bc74bf23-5e0d-47cb-abc3-509ced66fec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:39:20 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-96560e8f-d219-4919-80bf-a51f00de68ba tempest-SnapshotMetadataTestJSON-286141698 None] Created volume successfully.
Sep 10 11:39:21 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-bce4a7c1-a5fe-4b35-8db2-e407a37acc4a tempest-SnapshotMetadataTestJSON-286141698 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:39:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bce4a7c1-a5fe-4b35-8db2-e407a37acc4a tempest-SnapshotMetadataTestJSON-286141698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:39:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bce4a7c1-a5fe-4b35-8db2-e407a37acc4a tempest-SnapshotMetadataTestJSON-286141698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:39:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-bce4a7c1-a5fe-4b35-8db2-e407a37acc4a tempest-SnapshotMetadataTestJSON-286141698 None] Creating offline snapshot fae7124e-86d9-4c62-92cd-cde7e3af6811 of volume 29f10930-151a-4cb9-869d-9c8fdb0e5ecc {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 11:39:21 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bba2275-02e4-4f82-833b-074993732425]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:39:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bce4a7c1-a5fe-4b35-8db2-e407a37acc4a tempest-SnapshotMetadataTestJSON-286141698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:39:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:39:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:39:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:39:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:39:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:39:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:22 devstack quobyte-client[82616]: System call of process 89736 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:39:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.108s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:22 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:39:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bce4a7c1-a5fe-4b35-8db2-e407a37acc4a tempest-SnapshotMetadataTestJSON-286141698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc" returned: 0 in 0.666s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bce4a7c1-a5fe-4b35-8db2-e407a37acc4a tempest-SnapshotMetadataTestJSON-286141698 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc.fae7124e-86d9-4c62-92cd-cde7e3af6811 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:22 devstack quobyte-client[82616]: System call of process 89744 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:39:22 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=35, name=volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc.fae7124e-86d9-4c62-92cd-cde7e3af6811, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:39:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bce4a7c1-a5fe-4b35-8db2-e407a37acc4a tempest-SnapshotMetadataTestJSON-286141698 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc.fae7124e-86d9-4c62-92cd-cde7e3af6811 1G" returned: 0 in 0.333s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bce4a7c1-a5fe-4b35-8db2-e407a37acc4a tempest-SnapshotMetadataTestJSON-286141698 None] Running cmd (subprocess): qemu-img rebase -u -b volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc.fae7124e-86d9-4c62-92cd-cde7e3af6811 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:22 devstack quobyte-client[82616]: System call of process 89747 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:39:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bce4a7c1-a5fe-4b35-8db2-e407a37acc4a tempest-SnapshotMetadataTestJSON-286141698 None] CMD "qemu-img rebase -u -b volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc.fae7124e-86d9-4c62-92cd-cde7e3af6811" returned: 0 in 0.175s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:23 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-bce4a7c1-a5fe-4b35-8db2-e407a37acc4a tempest-SnapshotMetadataTestJSON-286141698 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc.fae7124e-86d9-4c62-92cd-cde7e3af6811 is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:39:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bce4a7c1-a5fe-4b35-8db2-e407a37acc4a tempest-SnapshotMetadataTestJSON-286141698 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc.fae7124e-86d9-4c62-92cd-cde7e3af6811 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bce4a7c1-a5fe-4b35-8db2-e407a37acc4a tempest-SnapshotMetadataTestJSON-286141698 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc.fae7124e-86d9-4c62-92cd-cde7e3af6811" returned: 0 in 0.157s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:23 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-bce4a7c1-a5fe-4b35-8db2-e407a37acc4a tempest-SnapshotMetadataTestJSON-286141698 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 11:39:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bce4a7c1-a5fe-4b35-8db2-e407a37acc4a tempest-SnapshotMetadataTestJSON-286141698 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc.fae7124e-86d9-4c62-92cd-cde7e3af6811 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bce4a7c1-a5fe-4b35-8db2-e407a37acc4a tempest-SnapshotMetadataTestJSON-286141698 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc.fae7124e-86d9-4c62-92cd-cde7e3af6811" returned: 0 in 0.160s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bce4a7c1-a5fe-4b35-8db2-e407a37acc4a tempest-SnapshotMetadataTestJSON-286141698 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bce4a7c1-a5fe-4b35-8db2-e407a37acc4a tempest-SnapshotMetadataTestJSON-286141698 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc.info" returned: 0 in 0.206s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:23 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-bce4a7c1-a5fe-4b35-8db2-e407a37acc4a tempest-SnapshotMetadataTestJSON-286141698 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc.info is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:39:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bce4a7c1-a5fe-4b35-8db2-e407a37acc4a tempest-SnapshotMetadataTestJSON-286141698 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bce4a7c1-a5fe-4b35-8db2-e407a37acc4a tempest-SnapshotMetadataTestJSON-286141698 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc.info" returned: 0 in 0.174s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bce4a7c1-a5fe-4b35-8db2-e407a37acc4a tempest-SnapshotMetadataTestJSON-286141698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.310s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:39:24 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-bce4a7c1-a5fe-4b35-8db2-e407a37acc4a tempest-SnapshotMetadataTestJSON-286141698 None] Create snapshot completed successfully
Sep 10 11:39:27 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8a00df5e-f7fe-450f-b58d-6fb1f64d7807 tempest-SnapshotMetadataTestJSON-286141698 None] Acquiring lock "cinder-fae7124e-86d9-4c62-92cd-cde7e3af6811-delete_snapshot" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:39:27 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8a00df5e-f7fe-450f-b58d-6fb1f64d7807 tempest-SnapshotMetadataTestJSON-286141698 None] Lock "cinder-fae7124e-86d9-4c62-92cd-cde7e3af6811-delete_snapshot" acquired by "delete_snapshot" :: waited 0.329s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:39:27 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-8a00df5e-f7fe-450f-b58d-6fb1f64d7807 tempest-SnapshotMetadataTestJSON-286141698 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:39:27 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8a00df5e-f7fe-450f-b58d-6fb1f64d7807 tempest-SnapshotMetadataTestJSON-286141698 None] Acquiring lock "cinder-quobyte-29f10930-151a-4cb9-869d-9c8fdb0e5ecc" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:39:27 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8a00df5e-f7fe-450f-b58d-6fb1f64d7807 tempest-SnapshotMetadataTestJSON-286141698 None] Lock "cinder-quobyte-29f10930-151a-4cb9-869d-9c8fdb0e5ecc" acquired by "delete_snapshot" :: waited 0.056s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:39:27 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8a00df5e-f7fe-450f-b58d-6fb1f64d7807 tempest-SnapshotMetadataTestJSON-286141698 None] Acquiring lock "cinder-quobyte-fae7124e-86d9-4c62-92cd-cde7e3af6811" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:39:28 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8a00df5e-f7fe-450f-b58d-6fb1f64d7807 tempest-SnapshotMetadataTestJSON-286141698 None] Lock "cinder-quobyte-fae7124e-86d9-4c62-92cd-cde7e3af6811" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:39:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-8a00df5e-f7fe-450f-b58d-6fb1f64d7807 tempest-SnapshotMetadataTestJSON-286141698 None] Deleting offline snapshot fae7124e-86d9-4c62-92cd-cde7e3af6811 of volume 29f10930-151a-4cb9-869d-9c8fdb0e5ecc {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 11:39:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-8a00df5e-f7fe-450f-b58d-6fb1f64d7807 tempest-SnapshotMetadataTestJSON-286141698 None] snapshot_file for this snap is: volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc.fae7124e-86d9-4c62-92cd-cde7e3af6811 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 11:39:28 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[adce5d66-f04b-4960-ae72-3abc10a50bc8]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:39:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8a00df5e-f7fe-450f-b58d-6fb1f64d7807 tempest-SnapshotMetadataTestJSON-286141698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc.fae7124e-86d9-4c62-92cd-cde7e3af6811 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:29 devstack quobyte-client[82616]: System call of process 89798 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:39:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8a00df5e-f7fe-450f-b58d-6fb1f64d7807 tempest-SnapshotMetadataTestJSON-286141698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc.fae7124e-86d9-4c62-92cd-cde7e3af6811" returned: 0 in 1.231s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-8a00df5e-f7fe-450f-b58d-6fb1f64d7807 tempest-SnapshotMetadataTestJSON-286141698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:39:29 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[86937f6b-f76c-4fab-9daf-7f8007670ca5]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:39:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8a00df5e-f7fe-450f-b58d-6fb1f64d7807 tempest-SnapshotMetadataTestJSON-286141698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:30 devstack quobyte-client[82616]: System call of process 89807 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:39:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8a00df5e-f7fe-450f-b58d-6fb1f64d7807 tempest-SnapshotMetadataTestJSON-286141698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc" returned: 0 in 0.902s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8a00df5e-f7fe-450f-b58d-6fb1f64d7807 tempest-SnapshotMetadataTestJSON-286141698 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc.fae7124e-86d9-4c62-92cd-cde7e3af6811 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:30 devstack quobyte-client[82616]: System call of process 89815 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:39:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8a00df5e-f7fe-450f-b58d-6fb1f64d7807 tempest-SnapshotMetadataTestJSON-286141698 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc.fae7124e-86d9-4c62-92cd-cde7e3af6811" returned: 0 in 0.784s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8a00df5e-f7fe-450f-b58d-6fb1f64d7807 tempest-SnapshotMetadataTestJSON-286141698 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc.fae7124e-86d9-4c62-92cd-cde7e3af6811 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:31 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:39:31 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:39:31 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Flow 'volume_create_manager' (72bc7914-5676-49e4-b2c2-ffae1d3a1d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:39:31 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ce0dd9c-171c-4a4a-b9f0-3771277d974c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:39:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8a00df5e-f7fe-450f-b58d-6fb1f64d7807 tempest-SnapshotMetadataTestJSON-286141698 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc.fae7124e-86d9-4c62-92cd-cde7e3af6811" returned: 0 in 0.425s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:31 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ce0dd9c-171c-4a4a-b9f0-3771277d974c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1018959504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=670a598a-95e4-4944-abd3-85d77182286d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e039e2c721a49bc8c57fb0009d5d067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:39:31Z,use_quota=True,user_id='189699eda7464e51ad15a2df6c990bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:39:31 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b55b024-6a18-477e-816c-923ad5a0b0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:39:31 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b55b024-6a18-477e-816c-923ad5a0b0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:39:31 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f56c0bc-75ec-46f9-b2cb-18f38c5d2374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:39:31 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f56c0bc-75ec-46f9-b2cb-18f38c5d2374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '670a598a-95e4-4944-abd3-85d77182286d', 'volume_name': 'volume-670a598a-95e4-4944-abd3-85d77182286d', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:39:31 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24065dd-e286-42e7-a578-9bcb7d29d220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:39:31 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24065dd-e286-42e7-a578-9bcb7d29d220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:39:31 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bdac8f1-beaf-41a8-acf8-7214111c94d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:39:31 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Volume 670a598a-95e4-4944-abd3-85d77182286d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-670a598a-95e4-4944-abd3-85d77182286d', 'volume_size': 1}
Sep 10 11:39:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:39:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:39:31 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1018959504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=670a598a-95e4-4944-abd3-85d77182286d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e039e2c721a49bc8c57fb0009d5d067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:39:31Z,use_quota=True,user_id='189699eda7464e51ad15a2df6c990bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:39:31 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Creating volume 670a598a-95e4-4944-abd3-85d77182286d {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:39:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:39:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:39:31 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:39:31 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:39:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:39:31 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:39:31 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:39:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-670a598a-95e4-4944-abd3-85d77182286d 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:32 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=37, name=volume-670a598a-95e4-4944-abd3-85d77182286d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:39:32 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8a00df5e-f7fe-450f-b58d-6fb1f64d7807 tempest-SnapshotMetadataTestJSON-286141698 None] Lock "cinder-quobyte-fae7124e-86d9-4c62-92cd-cde7e3af6811" released by "_delete_snapshot" :: held 4.071s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:39:32 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8a00df5e-f7fe-450f-b58d-6fb1f64d7807 tempest-SnapshotMetadataTestJSON-286141698 None] Lock "cinder-quobyte-29f10930-151a-4cb9-869d-9c8fdb0e5ecc" released by "delete_snapshot" :: held 4.161s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:39:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-670a598a-95e4-4944-abd3-85d77182286d 1073741824" returned: 0 in 0.460s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-670a598a-95e4-4944-abd3-85d77182286d {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-670a598a-95e4-4944-abd3-85d77182286d" returned: 0 in 0.281s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:32 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] <== create_volume: return (779ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:39:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:39:32 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bdac8f1-beaf-41a8-acf8-7214111c94d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-670a598a-95e4-4944-abd3-85d77182286d', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:39:32 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc36444-3ab4-469e-a62c-e7488c84a58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:39:32 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Volume volume-670a598a-95e4-4944-abd3-85d77182286d (670a598a-95e4-4944-abd3-85d77182286d): created successfully
Sep 10 11:39:32 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc36444-3ab4-469e-a62c-e7488c84a58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:39:32 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Flow 'volume_create_manager' (72bc7914-5676-49e4-b2c2-ffae1d3a1d23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:39:32 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-8a00df5e-f7fe-450f-b58d-6fb1f64d7807 tempest-SnapshotMetadataTestJSON-286141698 None] Created reservations ['b2b5339e-aafa-4212-a5c1-a2607597bfa4', '4cc20fac-e153-40c5-89c2-bff93ce58098', '06ff5fe2-acb6-40ae-a90f-e3f803dba2a6', '6170ced1-2c7d-4267-917c-ddcac16ed750'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:39:32 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-c2669ac2-db74-4076-a58d-ea7081962a91 tempest-AttachVolumeShelveTestJSON-1374435819 None] Created volume successfully.
Sep 10 11:39:33 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-8a00df5e-f7fe-450f-b58d-6fb1f64d7807 tempest-SnapshotMetadataTestJSON-286141698 None] Delete snapshot completed successfully.
Sep 10 11:39:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8a00df5e-f7fe-450f-b58d-6fb1f64d7807 tempest-SnapshotMetadataTestJSON-286141698 None] Lock "cinder-fae7124e-86d9-4c62-92cd-cde7e3af6811-delete_snapshot" released by "delete_snapshot" :: held 5.235s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:39:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6c70cab0-61b3-49e7-9ff9-3ab1aa497991 tempest-SnapshotMetadataTestJSON-286141698 None] Acquiring lock "cinder-29f10930-151a-4cb9-869d-9c8fdb0e5ecc-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:39:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6c70cab0-61b3-49e7-9ff9-3ab1aa497991 tempest-SnapshotMetadataTestJSON-286141698 None] Lock "cinder-29f10930-151a-4cb9-869d-9c8fdb0e5ecc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:39:33 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-6c70cab0-61b3-49e7-9ff9-3ab1aa497991 tempest-SnapshotMetadataTestJSON-286141698 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:39:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6c70cab0-61b3-49e7-9ff9-3ab1aa497991 tempest-SnapshotMetadataTestJSON-286141698 None] Acquiring lock "cinder-quobyte-29f10930-151a-4cb9-869d-9c8fdb0e5ecc" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:39:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6c70cab0-61b3-49e7-9ff9-3ab1aa497991 tempest-SnapshotMetadataTestJSON-286141698 None] Lock "cinder-quobyte-29f10930-151a-4cb9-869d-9c8fdb0e5ecc" acquired by "delete_volume" :: waited 0.015s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:39:33 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5988beb4-93c9-472d-a8f8-2604f8658d24]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:39:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6c70cab0-61b3-49e7-9ff9-3ab1aa497991 tempest-SnapshotMetadataTestJSON-286141698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6c70cab0-61b3-49e7-9ff9-3ab1aa497991 tempest-SnapshotMetadataTestJSON-286141698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc" returned: 0 in 0.628s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6c70cab0-61b3-49e7-9ff9-3ab1aa497991 tempest-SnapshotMetadataTestJSON-286141698 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6c70cab0-61b3-49e7-9ff9-3ab1aa497991 tempest-SnapshotMetadataTestJSON-286141698 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-29f10930-151a-4cb9-869d-9c8fdb0e5ecc" returned: 0 in 0.102s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:34 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6c70cab0-61b3-49e7-9ff9-3ab1aa497991 tempest-SnapshotMetadataTestJSON-286141698 None] Lock "cinder-quobyte-29f10930-151a-4cb9-869d-9c8fdb0e5ecc" released by "delete_volume" :: held 0.919s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:39:34 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-6c70cab0-61b3-49e7-9ff9-3ab1aa497991 tempest-SnapshotMetadataTestJSON-286141698 None] Created reservations ['3ceff2ae-dd5d-40d2-9b1a-bb33200460ef', '0a67a2b8-e49f-4040-97d3-8ad3ebbd3e44', 'a2ef8fad-c5e1-4186-81c4-badfa7cd9951', 'e566789e-b68f-41f1-a684-6c44e515e069'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:39:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6c70cab0-61b3-49e7-9ff9-3ab1aa497991 tempest-SnapshotMetadataTestJSON-286141698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:39:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6c70cab0-61b3-49e7-9ff9-3ab1aa497991 tempest-SnapshotMetadataTestJSON-286141698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:39:35 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6c70cab0-61b3-49e7-9ff9-3ab1aa497991 tempest-SnapshotMetadataTestJSON-286141698 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:39:35 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6c70cab0-61b3-49e7-9ff9-3ab1aa497991 tempest-SnapshotMetadataTestJSON-286141698 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:39:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6c70cab0-61b3-49e7-9ff9-3ab1aa497991 tempest-SnapshotMetadataTestJSON-286141698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:39:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6c70cab0-61b3-49e7-9ff9-3ab1aa497991 tempest-SnapshotMetadataTestJSON-286141698 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6c70cab0-61b3-49e7-9ff9-3ab1aa497991 tempest-SnapshotMetadataTestJSON-286141698 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.116s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:35 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-6c70cab0-61b3-49e7-9ff9-3ab1aa497991 tempest-SnapshotMetadataTestJSON-286141698 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:39:35 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-6c70cab0-61b3-49e7-9ff9-3ab1aa497991 tempest-SnapshotMetadataTestJSON-286141698 None] Deleted volume successfully.
Sep 10 11:39:35 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6c70cab0-61b3-49e7-9ff9-3ab1aa497991 tempest-SnapshotMetadataTestJSON-286141698 None] Lock "cinder-29f10930-151a-4cb9-869d-9c8fdb0e5ecc-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:39:45 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=12,cinder:DELETE=2,cinder:SELECT=13,cinder:INSERT=3 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:39:45 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=13,cinder:UPDATE=25,cinder:DELETE=2,cinder:INSERT=5 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:39:51 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:39:51 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:39:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Flow 'volume_create_manager' (eed37505-6a73-44cc-92ce-01fe310f587c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:39:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed9fd21b-7576-4135-8354-12fa4520e8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:39:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed9fd21b-7576-4135-8354-12fa4520e8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-837114847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7ceba1-05df-46fd-a2ae-5e6e80d6ed52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19e8d2d2aa3e42089a5cf8ba702d7e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:39:51Z,use_quota=True,user_id='8c79fab00d31487a819bfdc85a2c3952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:39:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b379ef7c-6b37-46c3-b7de-3972362fc8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:39:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b379ef7c-6b37-46c3-b7de-3972362fc8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:39:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05c3ccdb-3493-4a97-bd79-3723ed310afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:39:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05c3ccdb-3493-4a97-bd79-3723ed310afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d7ceba1-05df-46fd-a2ae-5e6e80d6ed52', 'volume_name': 'volume-5d7ceba1-05df-46fd-a2ae-5e6e80d6ed52', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:39:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd925b45-80a9-4886-b939-a9c3f3bc41d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:39:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd925b45-80a9-4886-b939-a9c3f3bc41d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:39:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be36502b-b0f5-47e6-b2db-5b775435747a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:39:51 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Volume 5d7ceba1-05df-46fd-a2ae-5e6e80d6ed52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d7ceba1-05df-46fd-a2ae-5e6e80d6ed52', 'volume_size': 1}
Sep 10 11:39:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:39:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.020s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:39:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-837114847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7ceba1-05df-46fd-a2ae-5e6e80d6ed52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19e8d2d2aa3e42089a5cf8ba702d7e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:39:51Z,use_quota=True,user_id='8c79fab00d31487a819bfdc85a2c3952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:39:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Creating volume 5d7ceba1-05df-46fd-a2ae-5e6e80d6ed52 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:39:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:39:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:39:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:39:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:39:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:39:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:39:51 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:39:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5d7ceba1-05df-46fd-a2ae-5e6e80d6ed52 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:52 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=38, name=volume-5d7ceba1-05df-46fd-a2ae-5e6e80d6ed52, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:39:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5d7ceba1-05df-46fd-a2ae-5e6e80d6ed52 1073741824" returned: 0 in 1.135s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5d7ceba1-05df-46fd-a2ae-5e6e80d6ed52 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:39:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5d7ceba1-05df-46fd-a2ae-5e6e80d6ed52" returned: 0 in 0.387s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:39:53 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] <== create_volume: return (1768ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:39:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:39:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be36502b-b0f5-47e6-b2db-5b775435747a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d7ceba1-05df-46fd-a2ae-5e6e80d6ed52', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:39:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60d0d49-bf7e-408d-9d0c-a31442160ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:39:54 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Volume volume-5d7ceba1-05df-46fd-a2ae-5e6e80d6ed52 (5d7ceba1-05df-46fd-a2ae-5e6e80d6ed52): created successfully
Sep 10 11:39:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60d0d49-bf7e-408d-9d0c-a31442160ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:39:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Flow 'volume_create_manager' (eed37505-6a73-44cc-92ce-01fe310f587c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:39:54 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-9e5faa0c-0035-4c3b-bb3a-83487c36cdf2 tempest-VolumesTransfersTest-600793066 None] Created volume successfully.
Sep 10 11:39:58 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-8184e64e-4b02-4dbb-a95d-a2ad96e5747f tempest-VolumesTransfersTest-556963533 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:39:58 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-8184e64e-4b02-4dbb-a95d-a2ad96e5747f tempest-VolumesTransfersTest-556963533 None] Transfer volume completed successfully.
Sep 10 11:39:59 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7dab80a6-315c-4cde-83ca-6a6738185c49 tempest-VolumesTransfersTest-792958335 None] Acquiring lock "cinder-5d7ceba1-05df-46fd-a2ae-5e6e80d6ed52-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:39:59 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7dab80a6-315c-4cde-83ca-6a6738185c49 tempest-VolumesTransfersTest-792958335 None] Lock "cinder-5d7ceba1-05df-46fd-a2ae-5e6e80d6ed52-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:39:59 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-7dab80a6-315c-4cde-83ca-6a6738185c49 tempest-VolumesTransfersTest-792958335 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:39:59 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7dab80a6-315c-4cde-83ca-6a6738185c49 tempest-VolumesTransfersTest-792958335 None] Acquiring lock "cinder-quobyte-5d7ceba1-05df-46fd-a2ae-5e6e80d6ed52" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:39:59 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7dab80a6-315c-4cde-83ca-6a6738185c49 tempest-VolumesTransfersTest-792958335 None] Lock "cinder-quobyte-5d7ceba1-05df-46fd-a2ae-5e6e80d6ed52" acquired by "delete_volume" :: waited 0.031s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:39:59 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2348215d-6c13-42ad-8cf7-e283c44ce893]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:39:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7dab80a6-315c-4cde-83ca-6a6738185c49 tempest-VolumesTransfersTest-792958335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5d7ceba1-05df-46fd-a2ae-5e6e80d6ed52 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:40:01 devstack quobyte-client[82616]: System call of process 90082 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:40:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7dab80a6-315c-4cde-83ca-6a6738185c49 tempest-VolumesTransfersTest-792958335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5d7ceba1-05df-46fd-a2ae-5e6e80d6ed52" returned: 0 in 1.456s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:40:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7dab80a6-315c-4cde-83ca-6a6738185c49 tempest-VolumesTransfersTest-792958335 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5d7ceba1-05df-46fd-a2ae-5e6e80d6ed52 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:40:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7dab80a6-315c-4cde-83ca-6a6738185c49 tempest-VolumesTransfersTest-792958335 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5d7ceba1-05df-46fd-a2ae-5e6e80d6ed52" returned: 0 in 0.182s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:40:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7dab80a6-315c-4cde-83ca-6a6738185c49 tempest-VolumesTransfersTest-792958335 None] Lock "cinder-quobyte-5d7ceba1-05df-46fd-a2ae-5e6e80d6ed52" released by "delete_volume" :: held 1.890s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:40:01 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-7dab80a6-315c-4cde-83ca-6a6738185c49 tempest-VolumesTransfersTest-792958335 None] Created reservations ['649d8db8-61b1-46e4-81d0-5baa7bff6d0a', '809584bc-6173-4628-9237-998f98be929c', 'd8b9d30e-fb08-4c97-afa0-33126924b62c', '6ae4668c-3203-4ee6-8b12-9d469d867002'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:40:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7dab80a6-315c-4cde-83ca-6a6738185c49 tempest-VolumesTransfersTest-792958335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:40:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7dab80a6-315c-4cde-83ca-6a6738185c49 tempest-VolumesTransfersTest-792958335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:40:02 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-7dab80a6-315c-4cde-83ca-6a6738185c49 tempest-VolumesTransfersTest-792958335 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:40:02 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-7dab80a6-315c-4cde-83ca-6a6738185c49 tempest-VolumesTransfersTest-792958335 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:40:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7dab80a6-315c-4cde-83ca-6a6738185c49 tempest-VolumesTransfersTest-792958335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:40:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7dab80a6-315c-4cde-83ca-6a6738185c49 tempest-VolumesTransfersTest-792958335 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:40:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7dab80a6-315c-4cde-83ca-6a6738185c49 tempest-VolumesTransfersTest-792958335 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.250s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:40:02 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-7dab80a6-315c-4cde-83ca-6a6738185c49 tempest-VolumesTransfersTest-792958335 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:40:02 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-7dab80a6-315c-4cde-83ca-6a6738185c49 tempest-VolumesTransfersTest-792958335 None] Deleted volume successfully.
Sep 10 11:40:03 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7dab80a6-315c-4cde-83ca-6a6738185c49 tempest-VolumesTransfersTest-792958335 None] Lock "cinder-5d7ceba1-05df-46fd-a2ae-5e6e80d6ed52-delete_volume" released by "delete_volume" :: held 3.555s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:40:04 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:40:04 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:40:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Flow 'volume_create_manager' (e2bf2fde-0f9d-4be3-8b06-5720706fe597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:40:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217981c8-fe79-401f-85d1-cf8ffc5c51d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:40:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217981c8-fe79-401f-85d1-cf8ffc5c51d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1690621969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e712d00-021c-4bcb-957c-a84ff7792be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19e8d2d2aa3e42089a5cf8ba702d7e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:40:04Z,use_quota=True,user_id='8c79fab00d31487a819bfdc85a2c3952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:40:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b0e1ff-861c-48c8-9a72-5880cef32ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:40:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b0e1ff-861c-48c8-9a72-5880cef32ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:40:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832b70e3-cac5-4272-a046-b4d9d5d49ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:40:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832b70e3-cac5-4272-a046-b4d9d5d49ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e712d00-021c-4bcb-957c-a84ff7792be1', 'volume_name': 'volume-8e712d00-021c-4bcb-957c-a84ff7792be1', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:40:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7c6f24f-4ea3-412c-9fc5-ea855a68abda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:40:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7c6f24f-4ea3-412c-9fc5-ea855a68abda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:40:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b84464d-312d-4225-8cf2-e3453769f0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:40:04 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Volume 8e712d00-021c-4bcb-957c-a84ff7792be1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e712d00-021c-4bcb-957c-a84ff7792be1', 'volume_size': 1}
Sep 10 11:40:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:40:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:40:04 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1690621969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e712d00-021c-4bcb-957c-a84ff7792be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19e8d2d2aa3e42089a5cf8ba702d7e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:40:04Z,use_quota=True,user_id='8c79fab00d31487a819bfdc85a2c3952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:40:04 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Creating volume 8e712d00-021c-4bcb-957c-a84ff7792be1 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:40:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:40:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:40:04 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:40:04 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:40:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:40:04 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:40:04 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:40:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8e712d00-021c-4bcb-957c-a84ff7792be1 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:40:04 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=39, name=volume-8e712d00-021c-4bcb-957c-a84ff7792be1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:40:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8e712d00-021c-4bcb-957c-a84ff7792be1 1073741824" returned: 0 in 0.515s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:40:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8e712d00-021c-4bcb-957c-a84ff7792be1 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:40:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8e712d00-021c-4bcb-957c-a84ff7792be1" returned: 0 in 0.334s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:40:05 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] <== create_volume: return (952ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:40:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:40:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b84464d-312d-4225-8cf2-e3453769f0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e712d00-021c-4bcb-957c-a84ff7792be1', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:40:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92396f28-eb8a-45a1-aa71-39bbd4bf1881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:40:06 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Volume volume-8e712d00-021c-4bcb-957c-a84ff7792be1 (8e712d00-021c-4bcb-957c-a84ff7792be1): created successfully
Sep 10 11:40:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92396f28-eb8a-45a1-aa71-39bbd4bf1881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:40:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Flow 'volume_create_manager' (e2bf2fde-0f9d-4be3-8b06-5720706fe597) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:40:06 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-67f7e932-4cac-4215-92da-46581a739194 tempest-VolumesTransfersTest-600793066 None] Created volume successfully.
Sep 10 11:40:06 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-22664797-e325-4a7b-ab58-d29bf2cb48fa req-043a10d6-870f-4b32-9c60-cd2ad4af809d tempest-AttachVolumeShelveTestJSON-1374435819 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:40:06 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-22664797-e325-4a7b-ab58-d29bf2cb48fa req-043a10d6-870f-4b32-9c60-cd2ad4af809d tempest-AttachVolumeShelveTestJSON-1374435819 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:40:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-22664797-e325-4a7b-ab58-d29bf2cb48fa req-043a10d6-870f-4b32-9c60-cd2ad4af809d tempest-AttachVolumeShelveTestJSON-1374435819 None] No connector for attachment 0c14c6b2-d71f-48c7-a56e-00f4550ce438; skipping storage backend terminate_connection call. {{(pid=82594) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}}
Sep 10 11:40:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-22664797-e325-4a7b-ab58-d29bf2cb48fa req-043a10d6-870f-4b32-9c60-cd2ad4af809d tempest-AttachVolumeShelveTestJSON-1374435819 None] Deleting attachment 0c14c6b2-d71f-48c7-a56e-00f4550ce438. {{(pid=82594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 11:40:07 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8d4d96d4-1755-4aca-99e6-d48a2559a61b tempest-VolumesTransfersTest-792958335 None] Acquiring lock "cinder-8e712d00-021c-4bcb-957c-a84ff7792be1-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:40:07 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8d4d96d4-1755-4aca-99e6-d48a2559a61b tempest-VolumesTransfersTest-792958335 None] Lock "cinder-8e712d00-021c-4bcb-957c-a84ff7792be1-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:40:07 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-8d4d96d4-1755-4aca-99e6-d48a2559a61b tempest-VolumesTransfersTest-792958335 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:40:07 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8d4d96d4-1755-4aca-99e6-d48a2559a61b tempest-VolumesTransfersTest-792958335 None] Acquiring lock "cinder-quobyte-8e712d00-021c-4bcb-957c-a84ff7792be1" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:40:07 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8d4d96d4-1755-4aca-99e6-d48a2559a61b tempest-VolumesTransfersTest-792958335 None] Lock "cinder-quobyte-8e712d00-021c-4bcb-957c-a84ff7792be1" acquired by "delete_volume" :: waited 0.027s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:40:07 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6a0ac7-b469-4bea-8d37-7083557c0715]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:40:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8d4d96d4-1755-4aca-99e6-d48a2559a61b tempest-VolumesTransfersTest-792958335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8e712d00-021c-4bcb-957c-a84ff7792be1 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:40:08 devstack quobyte-client[82616]: System call of process 90094 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:40:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8d4d96d4-1755-4aca-99e6-d48a2559a61b tempest-VolumesTransfersTest-792958335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8e712d00-021c-4bcb-957c-a84ff7792be1" returned: 0 in 1.329s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:40:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8d4d96d4-1755-4aca-99e6-d48a2559a61b tempest-VolumesTransfersTest-792958335 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8e712d00-021c-4bcb-957c-a84ff7792be1 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:40:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8d4d96d4-1755-4aca-99e6-d48a2559a61b tempest-VolumesTransfersTest-792958335 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8e712d00-021c-4bcb-957c-a84ff7792be1" returned: 0 in 0.256s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:40:09 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8d4d96d4-1755-4aca-99e6-d48a2559a61b tempest-VolumesTransfersTest-792958335 None] Lock "cinder-quobyte-8e712d00-021c-4bcb-957c-a84ff7792be1" released by "delete_volume" :: held 2.136s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:40:10 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-8d4d96d4-1755-4aca-99e6-d48a2559a61b tempest-VolumesTransfersTest-792958335 None] Created reservations ['3cf8831e-3fb3-4112-bf7e-c5bf4a00aa53', 'c5a66a6e-c7fc-46fa-8a2b-fcec4e4bc743', '217f9698-cf92-41c5-bf8e-7a6fad9124ab', '5bb9ee7e-43b2-429c-93a3-93aa083194ec'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:40:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8d4d96d4-1755-4aca-99e6-d48a2559a61b tempest-VolumesTransfersTest-792958335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:40:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8d4d96d4-1755-4aca-99e6-d48a2559a61b tempest-VolumesTransfersTest-792958335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:40:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-8d4d96d4-1755-4aca-99e6-d48a2559a61b tempest-VolumesTransfersTest-792958335 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:40:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-8d4d96d4-1755-4aca-99e6-d48a2559a61b tempest-VolumesTransfersTest-792958335 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:40:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8d4d96d4-1755-4aca-99e6-d48a2559a61b tempest-VolumesTransfersTest-792958335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:40:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8d4d96d4-1755-4aca-99e6-d48a2559a61b tempest-VolumesTransfersTest-792958335 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:40:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8d4d96d4-1755-4aca-99e6-d48a2559a61b tempest-VolumesTransfersTest-792958335 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.207s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:40:11 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-8d4d96d4-1755-4aca-99e6-d48a2559a61b tempest-VolumesTransfersTest-792958335 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:40:11 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-8d4d96d4-1755-4aca-99e6-d48a2559a61b tempest-VolumesTransfersTest-792958335 None] Deleted volume successfully.
Sep 10 11:40:12 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8d4d96d4-1755-4aca-99e6-d48a2559a61b tempest-VolumesTransfersTest-792958335 None] Lock "cinder-8e712d00-021c-4bcb-957c-a84ff7792be1-delete_volume" released by "delete_volume" :: held 4.696s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:40:21 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=16,cinder:UPDATE=27,cinder:INSERT=5,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:40:22 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=12,cinder:UPDATE=14,cinder:DELETE=3,cinder:INSERT=3 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:40:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:40:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:40:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:40:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:40:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:40:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:40:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:40:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.523s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:40:22 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:40:25 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:40:25 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:40:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Flow 'volume_create_manager' (a0bd3a4b-5b2f-4a92-b20d-118fbf769bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:40:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92819b50-c622-4167-94c7-2fb7cdcfc1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:40:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92819b50-c622-4167-94c7-2fb7cdcfc1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1573237420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c04ba33f-510d-401a-af0f-bd2197e23914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195cc51687794c5cb69297b4cf4f23bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:40:25Z,use_quota=True,user_id='bd5d5bb45a6c42718949144991e22ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:40:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec0d4f53-f817-41a5-a31b-ab371405d546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:40:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec0d4f53-f817-41a5-a31b-ab371405d546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:40:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc7720c-1d52-4c31-932c-83bcbd58f257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:40:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc7720c-1d52-4c31-932c-83bcbd58f257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c04ba33f-510d-401a-af0f-bd2197e23914', 'volume_name': 'volume-c04ba33f-510d-401a-af0f-bd2197e23914', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:40:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf0f9e1-6008-4704-b9ce-a979a16793fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:40:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf0f9e1-6008-4704-b9ce-a979a16793fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:40:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cbf45f6-ea42-49a6-8df2-b8a3fffdb39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:40:26 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Volume c04ba33f-510d-401a-af0f-bd2197e23914: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c04ba33f-510d-401a-af0f-bd2197e23914', 'volume_size': 1}
Sep 10 11:40:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:40:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:40:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1573237420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c04ba33f-510d-401a-af0f-bd2197e23914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195cc51687794c5cb69297b4cf4f23bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:40:25Z,use_quota=True,user_id='bd5d5bb45a6c42718949144991e22ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:40:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Creating volume c04ba33f-510d-401a-af0f-bd2197e23914 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:40:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:40:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:40:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:40:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:40:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:40:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:40:26 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:40:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c04ba33f-510d-401a-af0f-bd2197e23914 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:40:26 devstack quobyte-client[82616]: System call of process 90155 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:40:26 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=40, name=volume-c04ba33f-510d-401a-af0f-bd2197e23914, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:40:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c04ba33f-510d-401a-af0f-bd2197e23914 1073741824" returned: 0 in 0.715s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:40:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c04ba33f-510d-401a-af0f-bd2197e23914 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:40:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c04ba33f-510d-401a-af0f-bd2197e23914" returned: 0 in 0.213s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:40:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] <== create_volume: return (1107ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:40:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:40:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cbf45f6-ea42-49a6-8df2-b8a3fffdb39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c04ba33f-510d-401a-af0f-bd2197e23914', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:40:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b89aa3-0133-440f-9cf9-d9f42111d5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:40:28 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Volume volume-c04ba33f-510d-401a-af0f-bd2197e23914 (c04ba33f-510d-401a-af0f-bd2197e23914): created successfully
Sep 10 11:40:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b89aa3-0133-440f-9cf9-d9f42111d5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:40:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Flow 'volume_create_manager' (a0bd3a4b-5b2f-4a92-b20d-118fbf769bfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:40:28 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-f59cfdb3-f3e8-4faa-a892-938e3e86e860 tempest-VolumesTransfersV355Test-186816382 None] Created volume successfully.
Sep 10 11:40:30 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-1b62b783-f191-42dd-86ea-2e5be4acdc25 tempest-VolumesTransfersV355Test-1430251571 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:40:30 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-1b62b783-f191-42dd-86ea-2e5be4acdc25 tempest-VolumesTransfersV355Test-1430251571 None] Transfer volume completed successfully.
Sep 10 11:40:31 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9f098632-d236-49c5-aa9b-daf596329355 tempest-VolumesTransfersV355Test-1326184607 None] Acquiring lock "cinder-c04ba33f-510d-401a-af0f-bd2197e23914-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:40:32 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9f098632-d236-49c5-aa9b-daf596329355 tempest-VolumesTransfersV355Test-1326184607 None] Lock "cinder-c04ba33f-510d-401a-af0f-bd2197e23914-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:40:32 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-9f098632-d236-49c5-aa9b-daf596329355 tempest-VolumesTransfersV355Test-1326184607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:40:32 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9f098632-d236-49c5-aa9b-daf596329355 tempest-VolumesTransfersV355Test-1326184607 None] Acquiring lock "cinder-quobyte-c04ba33f-510d-401a-af0f-bd2197e23914" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:40:32 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9f098632-d236-49c5-aa9b-daf596329355 tempest-VolumesTransfersV355Test-1326184607 None] Lock "cinder-quobyte-c04ba33f-510d-401a-af0f-bd2197e23914" acquired by "delete_volume" :: waited 0.015s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:40:32 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fac65f-6da4-4b54-a434-808ceabd0583]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:40:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9f098632-d236-49c5-aa9b-daf596329355 tempest-VolumesTransfersV355Test-1326184607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c04ba33f-510d-401a-af0f-bd2197e23914 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:40:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9f098632-d236-49c5-aa9b-daf596329355 tempest-VolumesTransfersV355Test-1326184607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c04ba33f-510d-401a-af0f-bd2197e23914" returned: 0 in 0.502s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:40:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9f098632-d236-49c5-aa9b-daf596329355 tempest-VolumesTransfersV355Test-1326184607 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c04ba33f-510d-401a-af0f-bd2197e23914 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:40:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9f098632-d236-49c5-aa9b-daf596329355 tempest-VolumesTransfersV355Test-1326184607 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c04ba33f-510d-401a-af0f-bd2197e23914" returned: 0 in 0.129s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:40:32 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9f098632-d236-49c5-aa9b-daf596329355 tempest-VolumesTransfersV355Test-1326184607 None] Lock "cinder-quobyte-c04ba33f-510d-401a-af0f-bd2197e23914" released by "delete_volume" :: held 0.831s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:40:33 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-9f098632-d236-49c5-aa9b-daf596329355 tempest-VolumesTransfersV355Test-1326184607 None] Created reservations ['3d038f36-34ba-4bd1-95e2-9357d3173def', 'a11adff0-d60a-439f-83d6-ec41df2885b5', 'a4459494-d4a0-44b9-8e80-2c1632b8a3d5', '6e5c9bad-bccb-4ec1-a5e3-4104f5684222'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:40:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9f098632-d236-49c5-aa9b-daf596329355 tempest-VolumesTransfersV355Test-1326184607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:40:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9f098632-d236-49c5-aa9b-daf596329355 tempest-VolumesTransfersV355Test-1326184607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:40:33 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9f098632-d236-49c5-aa9b-daf596329355 tempest-VolumesTransfersV355Test-1326184607 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:40:33 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9f098632-d236-49c5-aa9b-daf596329355 tempest-VolumesTransfersV355Test-1326184607 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:40:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9f098632-d236-49c5-aa9b-daf596329355 tempest-VolumesTransfersV355Test-1326184607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:40:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9f098632-d236-49c5-aa9b-daf596329355 tempest-VolumesTransfersV355Test-1326184607 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:40:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9f098632-d236-49c5-aa9b-daf596329355 tempest-VolumesTransfersV355Test-1326184607 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.133s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:40:33 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-9f098632-d236-49c5-aa9b-daf596329355 tempest-VolumesTransfersV355Test-1326184607 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:40:33 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-9f098632-d236-49c5-aa9b-daf596329355 tempest-VolumesTransfersV355Test-1326184607 None] Deleted volume successfully.
Sep 10 11:40:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9f098632-d236-49c5-aa9b-daf596329355 tempest-VolumesTransfersV355Test-1326184607 None] Lock "cinder-c04ba33f-510d-401a-af0f-bd2197e23914-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:40:35 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:40:35 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:40:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Flow 'volume_create_manager' (9a5b6470-76d9-4298-aeaa-abfcc80a5604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:40:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f05b3bf7-34a2-486e-be27-226392288383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:40:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f05b3bf7-34a2-486e-be27-226392288383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1926886157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=722fbcf4-00e3-462c-90d4-e051fbe142af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195cc51687794c5cb69297b4cf4f23bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:40:35Z,use_quota=True,user_id='bd5d5bb45a6c42718949144991e22ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:40:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fb1a711-c71f-4475-886c-dee8a5a29f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:40:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fb1a711-c71f-4475-886c-dee8a5a29f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:40:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d02de8-57ef-4890-b00b-d89c30c662b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:40:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d02de8-57ef-4890-b00b-d89c30c662b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '722fbcf4-00e3-462c-90d4-e051fbe142af', 'volume_name': 'volume-722fbcf4-00e3-462c-90d4-e051fbe142af', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:40:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0debd957-0f33-4181-becf-1663f18ca2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:40:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0debd957-0f33-4181-becf-1663f18ca2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:40:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be98c165-8bae-4546-986f-5c28836dd5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:40:35 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Volume 722fbcf4-00e3-462c-90d4-e051fbe142af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-722fbcf4-00e3-462c-90d4-e051fbe142af', 'volume_size': 1}
Sep 10 11:40:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:40:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:40:35 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1926886157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=722fbcf4-00e3-462c-90d4-e051fbe142af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195cc51687794c5cb69297b4cf4f23bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:40:35Z,use_quota=True,user_id='bd5d5bb45a6c42718949144991e22ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:40:35 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Creating volume 722fbcf4-00e3-462c-90d4-e051fbe142af {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:40:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:40:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:40:35 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:40:35 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:40:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:40:35 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:40:35 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:40:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-722fbcf4-00e3-462c-90d4-e051fbe142af 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:40:35 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=41, name=volume-722fbcf4-00e3-462c-90d4-e051fbe142af, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:40:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-722fbcf4-00e3-462c-90d4-e051fbe142af 1073741824" returned: 0 in 0.532s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:40:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-722fbcf4-00e3-462c-90d4-e051fbe142af {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:40:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-722fbcf4-00e3-462c-90d4-e051fbe142af" returned: 0 in 0.097s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:40:36 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] <== create_volume: return (743ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:40:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:40:36 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be98c165-8bae-4546-986f-5c28836dd5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-722fbcf4-00e3-462c-90d4-e051fbe142af', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:40:36 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444874e3-0bf2-4978-9d15-d2d35ad0502d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:40:36 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Volume volume-722fbcf4-00e3-462c-90d4-e051fbe142af (722fbcf4-00e3-462c-90d4-e051fbe142af): created successfully
Sep 10 11:40:36 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444874e3-0bf2-4978-9d15-d2d35ad0502d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:40:36 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Flow 'volume_create_manager' (9a5b6470-76d9-4298-aeaa-abfcc80a5604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:40:36 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-eecf7910-d641-4486-aa98-db678318bb0e tempest-VolumesTransfersV355Test-186816382 None] Created volume successfully.
Sep 10 11:40:37 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-082a0c58-6d42-4e27-9b17-4acb73fb327d tempest-VolumesTransfersV355Test-1326184607 None] Acquiring lock "cinder-722fbcf4-00e3-462c-90d4-e051fbe142af-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:40:37 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-082a0c58-6d42-4e27-9b17-4acb73fb327d tempest-VolumesTransfersV355Test-1326184607 None] Lock "cinder-722fbcf4-00e3-462c-90d4-e051fbe142af-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:40:38 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-082a0c58-6d42-4e27-9b17-4acb73fb327d tempest-VolumesTransfersV355Test-1326184607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:40:38 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-082a0c58-6d42-4e27-9b17-4acb73fb327d tempest-VolumesTransfersV355Test-1326184607 None] Acquiring lock "cinder-quobyte-722fbcf4-00e3-462c-90d4-e051fbe142af" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:40:38 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-082a0c58-6d42-4e27-9b17-4acb73fb327d tempest-VolumesTransfersV355Test-1326184607 None] Lock "cinder-quobyte-722fbcf4-00e3-462c-90d4-e051fbe142af" acquired by "delete_volume" :: waited 0.025s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:40:38 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cb23c7-b2e7-4129-b29d-be314aa824b6]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:40:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-082a0c58-6d42-4e27-9b17-4acb73fb327d tempest-VolumesTransfersV355Test-1326184607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-722fbcf4-00e3-462c-90d4-e051fbe142af {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:40:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-082a0c58-6d42-4e27-9b17-4acb73fb327d tempest-VolumesTransfersV355Test-1326184607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-722fbcf4-00e3-462c-90d4-e051fbe142af" returned: 0 in 0.801s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:40:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-082a0c58-6d42-4e27-9b17-4acb73fb327d tempest-VolumesTransfersV355Test-1326184607 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-722fbcf4-00e3-462c-90d4-e051fbe142af {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:40:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-082a0c58-6d42-4e27-9b17-4acb73fb327d tempest-VolumesTransfersV355Test-1326184607 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-722fbcf4-00e3-462c-90d4-e051fbe142af" returned: 0 in 0.166s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:40:39 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-082a0c58-6d42-4e27-9b17-4acb73fb327d tempest-VolumesTransfersV355Test-1326184607 None] Lock "cinder-quobyte-722fbcf4-00e3-462c-90d4-e051fbe142af" released by "delete_volume" :: held 1.229s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:40:39 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-082a0c58-6d42-4e27-9b17-4acb73fb327d tempest-VolumesTransfersV355Test-1326184607 None] Created reservations ['a0649861-e056-4d39-83da-585d05086b8e', '1b5fb90b-4cae-457a-b76d-9aabc89d05a5', '57d96e4b-9ada-458e-8597-7ef34e4890b3', '7e74224b-165e-4986-97d4-a8814c4770f5'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:40:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-082a0c58-6d42-4e27-9b17-4acb73fb327d tempest-VolumesTransfersV355Test-1326184607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:40:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-082a0c58-6d42-4e27-9b17-4acb73fb327d tempest-VolumesTransfersV355Test-1326184607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:40:39 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-082a0c58-6d42-4e27-9b17-4acb73fb327d tempest-VolumesTransfersV355Test-1326184607 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:40:39 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-082a0c58-6d42-4e27-9b17-4acb73fb327d tempest-VolumesTransfersV355Test-1326184607 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:40:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-082a0c58-6d42-4e27-9b17-4acb73fb327d tempest-VolumesTransfersV355Test-1326184607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:40:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-082a0c58-6d42-4e27-9b17-4acb73fb327d tempest-VolumesTransfersV355Test-1326184607 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:40:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-082a0c58-6d42-4e27-9b17-4acb73fb327d tempest-VolumesTransfersV355Test-1326184607 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.117s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:40:40 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-082a0c58-6d42-4e27-9b17-4acb73fb327d tempest-VolumesTransfersV355Test-1326184607 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:40:40 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-082a0c58-6d42-4e27-9b17-4acb73fb327d tempest-VolumesTransfersV355Test-1326184607 None] Deleted volume successfully.
Sep 10 11:40:40 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-082a0c58-6d42-4e27-9b17-4acb73fb327d tempest-VolumesTransfersV355Test-1326184607 None] Lock "cinder-722fbcf4-00e3-462c-90d4-e051fbe142af-delete_volume" released by "delete_volume" :: held 2.635s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:40:49 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=17,cinder:UPDATE=23,cinder:INSERT=2,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:40:50 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=17,cinder:DELETE=3,cinder:SELECT=8,cinder:INSERT=6 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:41:02 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:41:02 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:41:02 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Flow 'volume_create_manager' (a59fed6c-8f4f-4267-97e3-7798965ebbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:41:02 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b625a284-9539-4381-a3db-be3c933e369f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:41:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b625a284-9539-4381-a3db-be3c933e369f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-563102246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4bf75e-0589-4b24-ac82-1118990a5276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5a3433184e440a0b27737939d1b9547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:41:03Z,use_quota=True,user_id='cb7fcbc92d384a078a2b274fc83a8c3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:41:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49e3d4e5-c1f0-40dc-a3a3-d583d5a4f2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:41:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49e3d4e5-c1f0-40dc-a3a3-d583d5a4f2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:41:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad529cff-3146-4c52-b581-59a939cac531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:41:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad529cff-3146-4c52-b581-59a939cac531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b4bf75e-0589-4b24-ac82-1118990a5276', 'volume_name': 'volume-3b4bf75e-0589-4b24-ac82-1118990a5276', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:41:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe113bc-e4fd-42b4-80ff-29c97e473546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:41:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe113bc-e4fd-42b4-80ff-29c97e473546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:41:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862df16c-adda-49f0-81ac-4ae76890af03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:41:03 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Volume 3b4bf75e-0589-4b24-ac82-1118990a5276: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b4bf75e-0589-4b24-ac82-1118990a5276', 'volume_size': 1}
Sep 10 11:41:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:41:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:41:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-563102246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4bf75e-0589-4b24-ac82-1118990a5276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5a3433184e440a0b27737939d1b9547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:41:03Z,use_quota=True,user_id='cb7fcbc92d384a078a2b274fc83a8c3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:41:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Creating volume 3b4bf75e-0589-4b24-ac82-1118990a5276 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:41:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:41:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:41:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:41:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:41:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:41:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:41:03 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:41:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3b4bf75e-0589-4b24-ac82-1118990a5276 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:41:03 devstack quobyte-client[82616]: System call of process 90342 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:41:03 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=42, name=volume-3b4bf75e-0589-4b24-ac82-1118990a5276, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:41:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3b4bf75e-0589-4b24-ac82-1118990a5276 1073741824" returned: 0 in 0.547s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:41:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3b4bf75e-0589-4b24-ac82-1118990a5276 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:41:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3b4bf75e-0589-4b24-ac82-1118990a5276" returned: 0 in 0.172s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:41:04 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] <== create_volume: return (888ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:41:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:41:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862df16c-adda-49f0-81ac-4ae76890af03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b4bf75e-0589-4b24-ac82-1118990a5276', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:41:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (218265f7-1977-4c9b-bbb5-f5cc73a58f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:41:04 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Volume volume-3b4bf75e-0589-4b24-ac82-1118990a5276 (3b4bf75e-0589-4b24-ac82-1118990a5276): created successfully
Sep 10 11:41:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (218265f7-1977-4c9b-bbb5-f5cc73a58f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:41:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Flow 'volume_create_manager' (a59fed6c-8f4f-4267-97e3-7798965ebbb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:41:04 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-a06cee56-de45-450b-827b-247247631d7d tempest-AttachVolumeNegativeTest-1236938792 None] Created volume successfully.
Sep 10 11:41:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-c0bf43f3-01eb-4c18-a05f-2825b30968dc req-6f97d4e5-2b5f-43f6-bcb1-ed247d3cfb4a tempest-AttachVolumeNegativeTest-1236938792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:41:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-c0bf43f3-01eb-4c18-a05f-2825b30968dc req-6f97d4e5-2b5f-43f6-bcb1-ed247d3cfb4a tempest-AttachVolumeNegativeTest-1236938792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:41:12 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ac1672-bb78-4a5e-b52e-83213d3b0aea]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:41:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-c0bf43f3-01eb-4c18-a05f-2825b30968dc req-6f97d4e5-2b5f-43f6-bcb1-ed247d3cfb4a tempest-AttachVolumeNegativeTest-1236938792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3b4bf75e-0589-4b24-ac82-1118990a5276 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:41:13 devstack quobyte-client[82616]: System call of process 90368 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:41:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-c0bf43f3-01eb-4c18-a05f-2825b30968dc req-6f97d4e5-2b5f-43f6-bcb1-ed247d3cfb4a tempest-AttachVolumeNegativeTest-1236938792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3b4bf75e-0589-4b24-ac82-1118990a5276" returned: 0 in 0.980s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:41:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-c0bf43f3-01eb-4c18-a05f-2825b30968dc req-6f97d4e5-2b5f-43f6-bcb1-ed247d3cfb4a tempest-AttachVolumeNegativeTest-1236938792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.082s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:41:14 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-c0bf43f3-01eb-4c18-a05f-2825b30968dc req-6f97d4e5-2b5f-43f6-bcb1-ed247d3cfb4a tempest-AttachVolumeNegativeTest-1236938792 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56', 'name': 'volume-3b4bf75e-0589-4b24-ac82-1118990a5276', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef272e43-5622-4042-9388-aa788e1b937d', 'enforce_multipath': True} {{(pid=82594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 11:41:14 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-c0bf43f3-01eb-4c18-a05f-2825b30968dc req-6f97d4e5-2b5f-43f6-bcb1-ed247d3cfb4a tempest-AttachVolumeNegativeTest-1236938792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:41:14 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-c0bf43f3-01eb-4c18-a05f-2825b30968dc req-6f97d4e5-2b5f-43f6-bcb1-ed247d3cfb4a tempest-AttachVolumeNegativeTest-1236938792 None] attachment_update completed successfully.
Sep 10 11:41:17 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:41:17 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:41:17 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Flow 'volume_create_manager' (da7ff9ec-2916-479b-bd89-5e03bf983c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:41:17 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815ba7eb-63ac-4054-9244-49d863c280d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:41:17 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815ba7eb-63ac-4054-9244-49d863c280d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1602201882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365d4ad3-b2e4-4942-84f3-496367c142a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271465064e0c4ff9a6509bcbc283b19b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:41:17Z,use_quota=True,user_id='8c93eec2ac164471911ce19169aebfb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:41:17 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5688cbd-b282-4018-89d6-2e1b4fddf9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:41:17 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5688cbd-b282-4018-89d6-2e1b4fddf9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:41:17 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f64f6f7-3cb8-44ee-baac-b90a27d5797c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:41:17 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f64f6f7-3cb8-44ee-baac-b90a27d5797c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '365d4ad3-b2e4-4942-84f3-496367c142a5', 'volume_name': 'volume-365d4ad3-b2e4-4942-84f3-496367c142a5', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:41:17 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ee94c7-1fd6-4fe5-824f-38b93c12acb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:41:17 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ee94c7-1fd6-4fe5-824f-38b93c12acb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:41:17 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b08a6d2-1257-4935-afaa-d3408e2e36fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:41:17 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Volume 365d4ad3-b2e4-4942-84f3-496367c142a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-365d4ad3-b2e4-4942-84f3-496367c142a5', 'volume_size': 1}
Sep 10 11:41:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:41:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:41:17 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1602201882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365d4ad3-b2e4-4942-84f3-496367c142a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271465064e0c4ff9a6509bcbc283b19b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:41:17Z,use_quota=True,user_id='8c93eec2ac164471911ce19169aebfb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:41:17 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Creating volume 365d4ad3-b2e4-4942-84f3-496367c142a5 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:41:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:41:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:41:17 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:41:18 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:41:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:41:18 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:41:18 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:41:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-365d4ad3-b2e4-4942-84f3-496367c142a5 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:41:18 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=43, name=volume-365d4ad3-b2e4-4942-84f3-496367c142a5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:41:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-365d4ad3-b2e4-4942-84f3-496367c142a5 1073741824" returned: 0 in 0.646s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:41:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-365d4ad3-b2e4-4942-84f3-496367c142a5 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:41:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-365d4ad3-b2e4-4942-84f3-496367c142a5" returned: 0 in 0.146s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:41:18 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] <== create_volume: return (890ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:41:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:41:19 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b08a6d2-1257-4935-afaa-d3408e2e36fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-365d4ad3-b2e4-4942-84f3-496367c142a5', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:41:19 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e91a08-9f77-4ac4-ae61-75ae1a84f249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:41:19 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Volume volume-365d4ad3-b2e4-4942-84f3-496367c142a5 (365d4ad3-b2e4-4942-84f3-496367c142a5): created successfully
Sep 10 11:41:19 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e91a08-9f77-4ac4-ae61-75ae1a84f249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:41:19 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Flow 'volume_create_manager' (da7ff9ec-2916-479b-bd89-5e03bf983c4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:41:19 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-a1de4f21-0ce9-4f17-a2f3-61e7e9d16a7b tempest-VolumesActionsTest-548721962 None] Created volume successfully.
Sep 10 11:41:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:41:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:41:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:41:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:41:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:41:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:41:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:41:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.306s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:41:22 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:41:29 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=6,cinder:SELECT=8,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:41:29 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:41:54 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-296180da-9bc3-4475-bace-6548e388c4d8 tempest-VolumesActionsTest-548721962 None] Acquiring lock "cinder-365d4ad3-b2e4-4942-84f3-496367c142a5" by "attach_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:41:55 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-296180da-9bc3-4475-bace-6548e388c4d8 tempest-VolumesActionsTest-548721962 None] Lock "cinder-365d4ad3-b2e4-4942-84f3-496367c142a5" acquired by "attach_volume" :: waited 0.075s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:41:55 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-296180da-9bc3-4475-bace-6548e388c4d8 tempest-VolumesActionsTest-548721962 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:41:55 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-296180da-9bc3-4475-bace-6548e388c4d8 tempest-VolumesActionsTest-548721962 None] Attaching volume 365d4ad3-b2e4-4942-84f3-496367c142a5 to instance 39a1990e-f1aa-4a33-9774-20e080539830 at mountpoint /dev/vdb on host None.
Sep 10 11:41:55 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-296180da-9bc3-4475-bace-6548e388c4d8 tempest-VolumesActionsTest-548721962 None] Attach volume completed successfully.
Sep 10 11:41:55 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-296180da-9bc3-4475-bace-6548e388c4d8 tempest-VolumesActionsTest-548721962 None] Lock "cinder-365d4ad3-b2e4-4942-84f3-496367c142a5" released by "attach_volume" :: held 0.719s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:41:55 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-c825c5aa-a03c-4a84-86c0-c31400d283b3 tempest-VolumesActionsTest-548721962 None] Acquiring lock "cinder-365d4ad3-b2e4-4942-84f3-496367c142a5-detach_volume" by "detach_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:41:56 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-c825c5aa-a03c-4a84-86c0-c31400d283b3 tempest-VolumesActionsTest-548721962 None] Lock "cinder-365d4ad3-b2e4-4942-84f3-496367c142a5-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:41:56 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-c825c5aa-a03c-4a84-86c0-c31400d283b3 tempest-VolumesActionsTest-548721962 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:41:56 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-c825c5aa-a03c-4a84-86c0-c31400d283b3 tempest-VolumesActionsTest-548721962 None] Detaching volume 365d4ad3-b2e4-4942-84f3-496367c142a5 from instance 39a1990e-f1aa-4a33-9774-20e080539830.
Sep 10 11:41:56 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-c825c5aa-a03c-4a84-86c0-c31400d283b3 tempest-VolumesActionsTest-548721962 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:41:56 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-c825c5aa-a03c-4a84-86c0-c31400d283b3 tempest-VolumesActionsTest-548721962 None] Detach volume completed successfully.
Sep 10 11:41:56 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-c825c5aa-a03c-4a84-86c0-c31400d283b3 tempest-VolumesActionsTest-548721962 None] Lock "cinder-365d4ad3-b2e4-4942-84f3-496367c142a5-detach_volume" released by "detach_volume" :: held 0.157s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:42:15 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=10,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:42:15 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:INSERT=1,cinder:SELECT=4,cinder:UPDATE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:42:19 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-75ae2bff-d032-4ded-bc37-d4fe7b866213 tempest-AttachVolumeShelveTestJSON-1374435819 None] Acquiring lock "cinder-670a598a-95e4-4944-abd3-85d77182286d-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:42:19 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-75ae2bff-d032-4ded-bc37-d4fe7b866213 tempest-AttachVolumeShelveTestJSON-1374435819 None] Lock "cinder-670a598a-95e4-4944-abd3-85d77182286d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:42:19 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-75ae2bff-d032-4ded-bc37-d4fe7b866213 tempest-AttachVolumeShelveTestJSON-1374435819 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:42:19 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-75ae2bff-d032-4ded-bc37-d4fe7b866213 tempest-AttachVolumeShelveTestJSON-1374435819 None] Acquiring lock "cinder-quobyte-670a598a-95e4-4944-abd3-85d77182286d" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:42:19 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-75ae2bff-d032-4ded-bc37-d4fe7b866213 tempest-AttachVolumeShelveTestJSON-1374435819 None] Lock "cinder-quobyte-670a598a-95e4-4944-abd3-85d77182286d" acquired by "delete_volume" :: waited 0.025s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:42:19 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aed8e4a-6ed0-4a75-9f5f-3914f2907e02]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:42:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-75ae2bff-d032-4ded-bc37-d4fe7b866213 tempest-AttachVolumeShelveTestJSON-1374435819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-670a598a-95e4-4944-abd3-85d77182286d {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:42:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-75ae2bff-d032-4ded-bc37-d4fe7b866213 tempest-AttachVolumeShelveTestJSON-1374435819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-670a598a-95e4-4944-abd3-85d77182286d" returned: 0 in 0.589s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:42:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-75ae2bff-d032-4ded-bc37-d4fe7b866213 tempest-AttachVolumeShelveTestJSON-1374435819 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-670a598a-95e4-4944-abd3-85d77182286d {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:42:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-75ae2bff-d032-4ded-bc37-d4fe7b866213 tempest-AttachVolumeShelveTestJSON-1374435819 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-670a598a-95e4-4944-abd3-85d77182286d" returned: 0 in 0.120s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:42:20 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-75ae2bff-d032-4ded-bc37-d4fe7b866213 tempest-AttachVolumeShelveTestJSON-1374435819 None] Lock "cinder-quobyte-670a598a-95e4-4944-abd3-85d77182286d" released by "delete_volume" :: held 0.904s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:42:21 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-75ae2bff-d032-4ded-bc37-d4fe7b866213 tempest-AttachVolumeShelveTestJSON-1374435819 None] Created reservations ['1e3717b4-d211-4bcd-a69d-64d1b9a3575f', 'f17473dc-a1ab-4a39-8711-542ef0324bfc', 'd1e08d63-a9cf-4a72-bf81-af325acd626e', '0c864fc8-9c10-4c0c-a70a-3aa3a0210b6c'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:42:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-75ae2bff-d032-4ded-bc37-d4fe7b866213 tempest-AttachVolumeShelveTestJSON-1374435819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:42:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-75ae2bff-d032-4ded-bc37-d4fe7b866213 tempest-AttachVolumeShelveTestJSON-1374435819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:42:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-75ae2bff-d032-4ded-bc37-d4fe7b866213 tempest-AttachVolumeShelveTestJSON-1374435819 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:42:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-75ae2bff-d032-4ded-bc37-d4fe7b866213 tempest-AttachVolumeShelveTestJSON-1374435819 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:42:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-75ae2bff-d032-4ded-bc37-d4fe7b866213 tempest-AttachVolumeShelveTestJSON-1374435819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:42:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-75ae2bff-d032-4ded-bc37-d4fe7b866213 tempest-AttachVolumeShelveTestJSON-1374435819 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:42:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-75ae2bff-d032-4ded-bc37-d4fe7b866213 tempest-AttachVolumeShelveTestJSON-1374435819 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.190s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:42:21 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-75ae2bff-d032-4ded-bc37-d4fe7b866213 tempest-AttachVolumeShelveTestJSON-1374435819 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:42:21 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-75ae2bff-d032-4ded-bc37-d4fe7b866213 tempest-AttachVolumeShelveTestJSON-1374435819 None] Deleted volume successfully.
Sep 10 11:42:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:42:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:42:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:42:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:42:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:42:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:42:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:42:23 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1e20f821-16a4-4c73-bd0a-27ddbfd0acf6 tempest-AttachVolumeShelveTestJSON-1374435819 None] Acquiring lock "cinder-5a524670-8b5e-4439-8c2d-0a9f945a067f-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:42:23 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1e20f821-16a4-4c73-bd0a-27ddbfd0acf6 tempest-AttachVolumeShelveTestJSON-1374435819 None] Lock "cinder-5a524670-8b5e-4439-8c2d-0a9f945a067f-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:42:23 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-75ae2bff-d032-4ded-bc37-d4fe7b866213 tempest-AttachVolumeShelveTestJSON-1374435819 None] Lock "cinder-670a598a-95e4-4944-abd3-85d77182286d-delete_volume" released by "delete_volume" :: held 3.684s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:42:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 1.006s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:42:23 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:42:24 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-1e20f821-16a4-4c73-bd0a-27ddbfd0acf6 tempest-AttachVolumeShelveTestJSON-1374435819 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:42:24 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1e20f821-16a4-4c73-bd0a-27ddbfd0acf6 tempest-AttachVolumeShelveTestJSON-1374435819 None] Acquiring lock "cinder-quobyte-5a524670-8b5e-4439-8c2d-0a9f945a067f" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:42:24 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1e20f821-16a4-4c73-bd0a-27ddbfd0acf6 tempest-AttachVolumeShelveTestJSON-1374435819 None] Lock "cinder-quobyte-5a524670-8b5e-4439-8c2d-0a9f945a067f" acquired by "delete_volume" :: waited 0.114s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:42:24 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbb0cc3-339f-4ee9-8b2c-636eedf9725a]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:42:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1e20f821-16a4-4c73-bd0a-27ddbfd0acf6 tempest-AttachVolumeShelveTestJSON-1374435819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5a524670-8b5e-4439-8c2d-0a9f945a067f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:42:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1e20f821-16a4-4c73-bd0a-27ddbfd0acf6 tempest-AttachVolumeShelveTestJSON-1374435819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5a524670-8b5e-4439-8c2d-0a9f945a067f" returned: 0 in 1.225s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:42:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1e20f821-16a4-4c73-bd0a-27ddbfd0acf6 tempest-AttachVolumeShelveTestJSON-1374435819 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5a524670-8b5e-4439-8c2d-0a9f945a067f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:42:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1e20f821-16a4-4c73-bd0a-27ddbfd0acf6 tempest-AttachVolumeShelveTestJSON-1374435819 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5a524670-8b5e-4439-8c2d-0a9f945a067f" returned: 0 in 0.245s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:42:26 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1e20f821-16a4-4c73-bd0a-27ddbfd0acf6 tempest-AttachVolumeShelveTestJSON-1374435819 None] Lock "cinder-quobyte-5a524670-8b5e-4439-8c2d-0a9f945a067f" released by "delete_volume" :: held 1.872s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:42:26 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-1e20f821-16a4-4c73-bd0a-27ddbfd0acf6 tempest-AttachVolumeShelveTestJSON-1374435819 None] Created reservations ['22cfa8c8-6bef-4dfb-9c1b-32887bd4fb1d', '3fe54c1a-880c-40a9-a000-f11cc6bfbfc8', '9f0f5715-3fe7-45aa-a50a-6da8922d0713', '8e562399-01bd-4077-8ebf-885b62b2593b'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:42:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1e20f821-16a4-4c73-bd0a-27ddbfd0acf6 tempest-AttachVolumeShelveTestJSON-1374435819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:42:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1e20f821-16a4-4c73-bd0a-27ddbfd0acf6 tempest-AttachVolumeShelveTestJSON-1374435819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:42:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1e20f821-16a4-4c73-bd0a-27ddbfd0acf6 tempest-AttachVolumeShelveTestJSON-1374435819 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:42:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1e20f821-16a4-4c73-bd0a-27ddbfd0acf6 tempest-AttachVolumeShelveTestJSON-1374435819 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:42:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1e20f821-16a4-4c73-bd0a-27ddbfd0acf6 tempest-AttachVolumeShelveTestJSON-1374435819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:42:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1e20f821-16a4-4c73-bd0a-27ddbfd0acf6 tempest-AttachVolumeShelveTestJSON-1374435819 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:42:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1e20f821-16a4-4c73-bd0a-27ddbfd0acf6 tempest-AttachVolumeShelveTestJSON-1374435819 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.327s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:42:27 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-1e20f821-16a4-4c73-bd0a-27ddbfd0acf6 tempest-AttachVolumeShelveTestJSON-1374435819 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:42:27 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-1e20f821-16a4-4c73-bd0a-27ddbfd0acf6 tempest-AttachVolumeShelveTestJSON-1374435819 None] Deleted volume successfully.
Sep 10 11:42:28 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1e20f821-16a4-4c73-bd0a-27ddbfd0acf6 tempest-AttachVolumeShelveTestJSON-1374435819 None] Lock "cinder-5a524670-8b5e-4439-8c2d-0a9f945a067f-delete_volume" released by "delete_volume" :: held 4.948s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:42:37 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=21,cinder:SELECT=12,cinder:DELETE=1,cinder:INSERT=4 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:42:38 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=8,cinder:INSERT=4,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:42:43 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:42:43 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:42:43 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Flow 'volume_create_manager' (8dcb5835-8417-43b6-b4df-7f37318a826e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:42:43 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8722095-be77-46f1-91ef-994cc8c1a7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:42:44 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8722095-be77-46f1-91ef-994cc8c1a7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1415717490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07af82d938e44c35b89cc8d5f5d63e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:42:43Z,use_quota=True,user_id='e82cf4a47d874a2495e9cfa46b2fba4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:42:44 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16612016-5064-4b0a-8f4e-d6a391c6b13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:42:44 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16612016-5064-4b0a-8f4e-d6a391c6b13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:42:44 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f68fa00a-a829-4b0b-aee3-0e823743132b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:42:44 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f68fa00a-a829-4b0b-aee3-0e823743132b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49', 'volume_name': 'volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:42:44 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a04fb15-1f0e-4c2f-91f8-75d49844c91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:42:44 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a04fb15-1f0e-4c2f-91f8-75d49844c91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:42:44 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4348299-791e-435d-8f0c-90052b15bdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:42:44 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Volume ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49', 'volume_size': 1}
Sep 10 11:42:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:42:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:42:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1415717490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07af82d938e44c35b89cc8d5f5d63e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:42:43Z,use_quota=True,user_id='e82cf4a47d874a2495e9cfa46b2fba4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:42:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Creating volume ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:42:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:42:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:42:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:42:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:42:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:42:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:42:44 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:42:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:42:44 devstack quobyte-client[82616]: System call of process 91312 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:42:44 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=44, name=volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:42:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49 1073741824" returned: 0 in 0.747s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:42:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:42:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49" returned: 0 in 0.166s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:42:45 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] <== create_volume: return (1102ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:42:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:42:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4348299-791e-435d-8f0c-90052b15bdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:42:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe81c00-7b01-4cd9-aea4-1fc72ae45d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:42:45 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Volume volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49 (ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49): created successfully
Sep 10 11:42:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe81c00-7b01-4cd9-aea4-1fc72ae45d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:42:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Flow 'volume_create_manager' (8dcb5835-8417-43b6-b4df-7f37318a826e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:42:45 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-fe3384e3-2a73-4695-816a-46b58c9df643 req-aacc0a7a-7800-4af2-8ffe-f52c0c1e0fbf tempest-VolumesSnapshotsTestJSON-268458836 None] Created volume successfully.
Sep 10 11:42:46 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-a9956d46-915b-4ed5-a6b4-054ea8bf5b5e req-8695faed-65e9-4fd1-8027-bae0dda6d82a tempest-VolumesSnapshotsTestJSON-268458836 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:42:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-a9956d46-915b-4ed5-a6b4-054ea8bf5b5e req-8695faed-65e9-4fd1-8027-bae0dda6d82a tempest-VolumesSnapshotsTestJSON-268458836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:42:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-a9956d46-915b-4ed5-a6b4-054ea8bf5b5e req-8695faed-65e9-4fd1-8027-bae0dda6d82a tempest-VolumesSnapshotsTestJSON-268458836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:42:46 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [req-a9956d46-915b-4ed5-a6b4-054ea8bf5b5e req-8695faed-65e9-4fd1-8027-bae0dda6d82a tempest-VolumesSnapshotsTestJSON-268458836 None] Creating offline snapshot 64200251-435f-4a47-aade-e7bbb0dfd8a4 of volume ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49 {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 11:42:46 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[176cfa35-b903-40b2-8890-e861f37d7d7c]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:42:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-a9956d46-915b-4ed5-a6b4-054ea8bf5b5e req-8695faed-65e9-4fd1-8027-bae0dda6d82a tempest-VolumesSnapshotsTestJSON-268458836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:42:46 devstack quobyte-client[82616]: System call of process 91323 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:42:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-a9956d46-915b-4ed5-a6b4-054ea8bf5b5e req-8695faed-65e9-4fd1-8027-bae0dda6d82a tempest-VolumesSnapshotsTestJSON-268458836 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49" returned: 0 in 0.531s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:42:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-a9956d46-915b-4ed5-a6b4-054ea8bf5b5e req-8695faed-65e9-4fd1-8027-bae0dda6d82a tempest-VolumesSnapshotsTestJSON-268458836 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49.64200251-435f-4a47-aade-e7bbb0dfd8a4 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:42:47 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=45, name=volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49.64200251-435f-4a47-aade-e7bbb0dfd8a4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:42:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-a9956d46-915b-4ed5-a6b4-054ea8bf5b5e req-8695faed-65e9-4fd1-8027-bae0dda6d82a tempest-VolumesSnapshotsTestJSON-268458836 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49.64200251-435f-4a47-aade-e7bbb0dfd8a4 1G" returned: 0 in 0.307s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:42:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-a9956d46-915b-4ed5-a6b4-054ea8bf5b5e req-8695faed-65e9-4fd1-8027-bae0dda6d82a tempest-VolumesSnapshotsTestJSON-268458836 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49 -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49.64200251-435f-4a47-aade-e7bbb0dfd8a4 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:42:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-a9956d46-915b-4ed5-a6b4-054ea8bf5b5e req-8695faed-65e9-4fd1-8027-bae0dda6d82a tempest-VolumesSnapshotsTestJSON-268458836 None] CMD "qemu-img rebase -u -b volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49 -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49.64200251-435f-4a47-aade-e7bbb0dfd8a4" returned: 0 in 0.200s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:42:47 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [req-a9956d46-915b-4ed5-a6b4-054ea8bf5b5e req-8695faed-65e9-4fd1-8027-bae0dda6d82a tempest-VolumesSnapshotsTestJSON-268458836 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49.64200251-435f-4a47-aade-e7bbb0dfd8a4 is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:42:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-a9956d46-915b-4ed5-a6b4-054ea8bf5b5e req-8695faed-65e9-4fd1-8027-bae0dda6d82a tempest-VolumesSnapshotsTestJSON-268458836 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49.64200251-435f-4a47-aade-e7bbb0dfd8a4 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:42:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-a9956d46-915b-4ed5-a6b4-054ea8bf5b5e req-8695faed-65e9-4fd1-8027-bae0dda6d82a tempest-VolumesSnapshotsTestJSON-268458836 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49.64200251-435f-4a47-aade-e7bbb0dfd8a4" returned: 0 in 0.159s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:42:47 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [req-a9956d46-915b-4ed5-a6b4-054ea8bf5b5e req-8695faed-65e9-4fd1-8027-bae0dda6d82a tempest-VolumesSnapshotsTestJSON-268458836 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49 -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 11:42:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-a9956d46-915b-4ed5-a6b4-054ea8bf5b5e req-8695faed-65e9-4fd1-8027-bae0dda6d82a tempest-VolumesSnapshotsTestJSON-268458836 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49.64200251-435f-4a47-aade-e7bbb0dfd8a4 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:42:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-a9956d46-915b-4ed5-a6b4-054ea8bf5b5e req-8695faed-65e9-4fd1-8027-bae0dda6d82a tempest-VolumesSnapshotsTestJSON-268458836 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49.64200251-435f-4a47-aade-e7bbb0dfd8a4" returned: 0 in 0.086s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:42:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-a9956d46-915b-4ed5-a6b4-054ea8bf5b5e req-8695faed-65e9-4fd1-8027-bae0dda6d82a tempest-VolumesSnapshotsTestJSON-268458836 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:42:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-a9956d46-915b-4ed5-a6b4-054ea8bf5b5e req-8695faed-65e9-4fd1-8027-bae0dda6d82a tempest-VolumesSnapshotsTestJSON-268458836 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49.info" returned: 0 in 0.100s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:42:48 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [req-a9956d46-915b-4ed5-a6b4-054ea8bf5b5e req-8695faed-65e9-4fd1-8027-bae0dda6d82a tempest-VolumesSnapshotsTestJSON-268458836 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49.info is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:42:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-a9956d46-915b-4ed5-a6b4-054ea8bf5b5e req-8695faed-65e9-4fd1-8027-bae0dda6d82a tempest-VolumesSnapshotsTestJSON-268458836 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:42:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-a9956d46-915b-4ed5-a6b4-054ea8bf5b5e req-8695faed-65e9-4fd1-8027-bae0dda6d82a tempest-VolumesSnapshotsTestJSON-268458836 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49.info" returned: 0 in 0.115s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:42:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-a9956d46-915b-4ed5-a6b4-054ea8bf5b5e req-8695faed-65e9-4fd1-8027-bae0dda6d82a tempest-VolumesSnapshotsTestJSON-268458836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.890s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:42:48 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5228d676-9db4-4480-a34a-455efdfd0829 tempest-VolumesActionsTest-548721962 None] Acquiring lock "cinder-365d4ad3-b2e4-4942-84f3-496367c142a5" by "attach_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:42:48 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-a9956d46-915b-4ed5-a6b4-054ea8bf5b5e req-8695faed-65e9-4fd1-8027-bae0dda6d82a tempest-VolumesSnapshotsTestJSON-268458836 None] Create snapshot completed successfully
Sep 10 11:42:48 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5228d676-9db4-4480-a34a-455efdfd0829 tempest-VolumesActionsTest-548721962 None] Lock "cinder-365d4ad3-b2e4-4942-84f3-496367c142a5" acquired by "attach_volume" :: waited 0.150s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:42:48 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-5228d676-9db4-4480-a34a-455efdfd0829 tempest-VolumesActionsTest-548721962 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:42:48 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-5228d676-9db4-4480-a34a-455efdfd0829 tempest-VolumesActionsTest-548721962 None] Attaching volume 365d4ad3-b2e4-4942-84f3-496367c142a5 to instance 03f586e2-d624-4d59-a67e-a2ca30ac0f96 at mountpoint /dev/vdb on host None.
Sep 10 11:42:48 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-5228d676-9db4-4480-a34a-455efdfd0829 tempest-VolumesActionsTest-548721962 None] Attach volume completed successfully.
Sep 10 11:42:48 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5228d676-9db4-4480-a34a-455efdfd0829 tempest-VolumesActionsTest-548721962 None] Lock "cinder-365d4ad3-b2e4-4942-84f3-496367c142a5" released by "attach_volume" :: held 0.218s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:42:49 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-55bf3d14-d403-4852-a49d-5ed8d6ca1ad0 tempest-VolumesActionsTest-548721962 None] Acquiring lock "cinder-365d4ad3-b2e4-4942-84f3-496367c142a5-detach_volume" by "detach_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:42:49 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-55bf3d14-d403-4852-a49d-5ed8d6ca1ad0 tempest-VolumesActionsTest-548721962 None] Lock "cinder-365d4ad3-b2e4-4942-84f3-496367c142a5-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:42:49 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-55bf3d14-d403-4852-a49d-5ed8d6ca1ad0 tempest-VolumesActionsTest-548721962 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:42:49 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-55bf3d14-d403-4852-a49d-5ed8d6ca1ad0 tempest-VolumesActionsTest-548721962 None] Detaching volume 365d4ad3-b2e4-4942-84f3-496367c142a5 from instance 03f586e2-d624-4d59-a67e-a2ca30ac0f96.
Sep 10 11:42:49 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-55bf3d14-d403-4852-a49d-5ed8d6ca1ad0 tempest-VolumesActionsTest-548721962 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:42:49 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-55bf3d14-d403-4852-a49d-5ed8d6ca1ad0 tempest-VolumesActionsTest-548721962 None] Detach volume completed successfully.
Sep 10 11:42:49 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-55bf3d14-d403-4852-a49d-5ed8d6ca1ad0 tempest-VolumesActionsTest-548721962 None] Lock "cinder-365d4ad3-b2e4-4942-84f3-496367c142a5-detach_volume" released by "detach_volume" :: held 0.088s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:42:49 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-c5aa4ef5-f386-415d-bf29-8d2623119b34 req-10660b2e-eba5-4b41-be1c-746991e9eda9 tempest-VolumesSnapshotsTestJSON-268458836 None] Acquiring lock "cinder-64200251-435f-4a47-aade-e7bbb0dfd8a4-delete_snapshot" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:42:49 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-c5aa4ef5-f386-415d-bf29-8d2623119b34 req-10660b2e-eba5-4b41-be1c-746991e9eda9 tempest-VolumesSnapshotsTestJSON-268458836 None] Lock "cinder-64200251-435f-4a47-aade-e7bbb0dfd8a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:42:49 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-c5aa4ef5-f386-415d-bf29-8d2623119b34 req-10660b2e-eba5-4b41-be1c-746991e9eda9 tempest-VolumesSnapshotsTestJSON-268458836 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:42:49 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-c5aa4ef5-f386-415d-bf29-8d2623119b34 req-10660b2e-eba5-4b41-be1c-746991e9eda9 tempest-VolumesSnapshotsTestJSON-268458836 None] Acquiring lock "cinder-quobyte-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:42:49 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-c5aa4ef5-f386-415d-bf29-8d2623119b34 req-10660b2e-eba5-4b41-be1c-746991e9eda9 tempest-VolumesSnapshotsTestJSON-268458836 None] Lock "cinder-quobyte-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49" acquired by "delete_snapshot" :: waited 0.054s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:42:49 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-c5aa4ef5-f386-415d-bf29-8d2623119b34 req-10660b2e-eba5-4b41-be1c-746991e9eda9 tempest-VolumesSnapshotsTestJSON-268458836 None] Acquiring lock "cinder-quobyte-64200251-435f-4a47-aade-e7bbb0dfd8a4" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:42:49 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-c5aa4ef5-f386-415d-bf29-8d2623119b34 req-10660b2e-eba5-4b41-be1c-746991e9eda9 tempest-VolumesSnapshotsTestJSON-268458836 None] Lock "cinder-quobyte-64200251-435f-4a47-aade-e7bbb0dfd8a4" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:42:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [req-c5aa4ef5-f386-415d-bf29-8d2623119b34 req-10660b2e-eba5-4b41-be1c-746991e9eda9 tempest-VolumesSnapshotsTestJSON-268458836 None] Deleting offline snapshot 64200251-435f-4a47-aade-e7bbb0dfd8a4 of volume ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 11:42:50 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [req-c5aa4ef5-f386-415d-bf29-8d2623119b34 req-10660b2e-eba5-4b41-be1c-746991e9eda9 tempest-VolumesSnapshotsTestJSON-268458836 None] snapshot_file for this snap is: volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49.64200251-435f-4a47-aade-e7bbb0dfd8a4 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 11:42:50 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5484c3-01a2-4fe3-944b-49c902ca4b23]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:42:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-c5aa4ef5-f386-415d-bf29-8d2623119b34 req-10660b2e-eba5-4b41-be1c-746991e9eda9 tempest-VolumesSnapshotsTestJSON-268458836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49.64200251-435f-4a47-aade-e7bbb0dfd8a4 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:42:50 devstack quobyte-client[82616]: System call of process 91337 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:42:50 devstack quobyte-client[82616]: System call of process 91337 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:42:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-c5aa4ef5-f386-415d-bf29-8d2623119b34 req-10660b2e-eba5-4b41-be1c-746991e9eda9 tempest-VolumesSnapshotsTestJSON-268458836 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49.64200251-435f-4a47-aade-e7bbb0dfd8a4" returned: 0 in 0.944s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:42:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [req-c5aa4ef5-f386-415d-bf29-8d2623119b34 req-10660b2e-eba5-4b41-be1c-746991e9eda9 tempest-VolumesSnapshotsTestJSON-268458836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:42:51 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b211cacf-4b27-4308-8526-38e338421b7c]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:42:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-c5aa4ef5-f386-415d-bf29-8d2623119b34 req-10660b2e-eba5-4b41-be1c-746991e9eda9 tempest-VolumesSnapshotsTestJSON-268458836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:42:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-c5aa4ef5-f386-415d-bf29-8d2623119b34 req-10660b2e-eba5-4b41-be1c-746991e9eda9 tempest-VolumesSnapshotsTestJSON-268458836 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49" returned: 0 in 1.897s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:42:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-c5aa4ef5-f386-415d-bf29-8d2623119b34 req-10660b2e-eba5-4b41-be1c-746991e9eda9 tempest-VolumesSnapshotsTestJSON-268458836 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49.64200251-435f-4a47-aade-e7bbb0dfd8a4 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:42:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-c5aa4ef5-f386-415d-bf29-8d2623119b34 req-10660b2e-eba5-4b41-be1c-746991e9eda9 tempest-VolumesSnapshotsTestJSON-268458836 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49.64200251-435f-4a47-aade-e7bbb0dfd8a4" returned: 0 in 0.357s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:42:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-c5aa4ef5-f386-415d-bf29-8d2623119b34 req-10660b2e-eba5-4b41-be1c-746991e9eda9 tempest-VolumesSnapshotsTestJSON-268458836 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49.64200251-435f-4a47-aade-e7bbb0dfd8a4 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:42:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-c5aa4ef5-f386-415d-bf29-8d2623119b34 req-10660b2e-eba5-4b41-be1c-746991e9eda9 tempest-VolumesSnapshotsTestJSON-268458836 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49.64200251-435f-4a47-aade-e7bbb0dfd8a4" returned: 0 in 0.223s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:42:53 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-c5aa4ef5-f386-415d-bf29-8d2623119b34 req-10660b2e-eba5-4b41-be1c-746991e9eda9 tempest-VolumesSnapshotsTestJSON-268458836 None] Lock "cinder-quobyte-64200251-435f-4a47-aade-e7bbb0dfd8a4" released by "_delete_snapshot" :: held 3.977s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:42:53 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-c5aa4ef5-f386-415d-bf29-8d2623119b34 req-10660b2e-eba5-4b41-be1c-746991e9eda9 tempest-VolumesSnapshotsTestJSON-268458836 None] Lock "cinder-quobyte-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49" released by "delete_snapshot" :: held 4.032s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:42:54 devstack cinder-volume[82594]: DEBUG cinder.quota [req-c5aa4ef5-f386-415d-bf29-8d2623119b34 req-10660b2e-eba5-4b41-be1c-746991e9eda9 tempest-VolumesSnapshotsTestJSON-268458836 None] Created reservations ['41c9193f-fa53-4b50-ad39-e68485bb8524', 'f7aac095-c10c-493c-a726-000be106f620', '81091eec-b174-4981-af31-0e59ae4457ce', 'c464dd9e-e993-417e-bf1d-c046adcb8b88'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:42:54 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-c5aa4ef5-f386-415d-bf29-8d2623119b34 req-10660b2e-eba5-4b41-be1c-746991e9eda9 tempest-VolumesSnapshotsTestJSON-268458836 None] Delete snapshot completed successfully.
Sep 10 11:42:54 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-c5aa4ef5-f386-415d-bf29-8d2623119b34 req-10660b2e-eba5-4b41-be1c-746991e9eda9 tempest-VolumesSnapshotsTestJSON-268458836 None] Lock "cinder-64200251-435f-4a47-aade-e7bbb0dfd8a4-delete_snapshot" released by "delete_snapshot" :: held 4.886s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:42:55 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-c0e05ad3-02f4-452c-b912-f75ab084161b req-d5a94e40-3649-47cd-901d-4204fb62e406 tempest-VolumesSnapshotsTestJSON-268458836 None] Acquiring lock "cinder-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:42:55 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-c0e05ad3-02f4-452c-b912-f75ab084161b req-d5a94e40-3649-47cd-901d-4204fb62e406 tempest-VolumesSnapshotsTestJSON-268458836 None] Lock "cinder-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:42:55 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-c0e05ad3-02f4-452c-b912-f75ab084161b req-d5a94e40-3649-47cd-901d-4204fb62e406 tempest-VolumesSnapshotsTestJSON-268458836 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:42:55 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-c0e05ad3-02f4-452c-b912-f75ab084161b req-d5a94e40-3649-47cd-901d-4204fb62e406 tempest-VolumesSnapshotsTestJSON-268458836 None] Acquiring lock "cinder-quobyte-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:42:55 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-c0e05ad3-02f4-452c-b912-f75ab084161b req-d5a94e40-3649-47cd-901d-4204fb62e406 tempest-VolumesSnapshotsTestJSON-268458836 None] Lock "cinder-quobyte-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49" acquired by "delete_volume" :: waited 0.039s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:42:55 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[33145ac9-dcd7-483b-b405-aefc64299959]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:42:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-c0e05ad3-02f4-452c-b912-f75ab084161b req-d5a94e40-3649-47cd-901d-4204fb62e406 tempest-VolumesSnapshotsTestJSON-268458836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:42:56 devstack quobyte-client[82616]: System call of process 91393 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:42:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-c0e05ad3-02f4-452c-b912-f75ab084161b req-d5a94e40-3649-47cd-901d-4204fb62e406 tempest-VolumesSnapshotsTestJSON-268458836 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49" returned: 0 in 0.867s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:42:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-c0e05ad3-02f4-452c-b912-f75ab084161b req-d5a94e40-3649-47cd-901d-4204fb62e406 tempest-VolumesSnapshotsTestJSON-268458836 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:42:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-c0e05ad3-02f4-452c-b912-f75ab084161b req-d5a94e40-3649-47cd-901d-4204fb62e406 tempest-VolumesSnapshotsTestJSON-268458836 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49" returned: 0 in 0.163s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:42:56 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-c0e05ad3-02f4-452c-b912-f75ab084161b req-d5a94e40-3649-47cd-901d-4204fb62e406 tempest-VolumesSnapshotsTestJSON-268458836 None] Lock "cinder-quobyte-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49" released by "delete_volume" :: held 1.209s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:42:56 devstack cinder-volume[82594]: DEBUG cinder.quota [req-c0e05ad3-02f4-452c-b912-f75ab084161b req-d5a94e40-3649-47cd-901d-4204fb62e406 tempest-VolumesSnapshotsTestJSON-268458836 None] Created reservations ['fa7801a9-ee33-4aa4-a548-681305f0884c', '3e7d0848-5715-4d72-92fe-1f17e9106526', '7a7c847c-673a-40d9-9b81-e7788313216b', 'abfb8002-3430-4283-804e-75992691f4aa'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:42:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-c0e05ad3-02f4-452c-b912-f75ab084161b req-d5a94e40-3649-47cd-901d-4204fb62e406 tempest-VolumesSnapshotsTestJSON-268458836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:42:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-c0e05ad3-02f4-452c-b912-f75ab084161b req-d5a94e40-3649-47cd-901d-4204fb62e406 tempest-VolumesSnapshotsTestJSON-268458836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:42:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [req-c0e05ad3-02f4-452c-b912-f75ab084161b req-d5a94e40-3649-47cd-901d-4204fb62e406 tempest-VolumesSnapshotsTestJSON-268458836 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:42:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [req-c0e05ad3-02f4-452c-b912-f75ab084161b req-d5a94e40-3649-47cd-901d-4204fb62e406 tempest-VolumesSnapshotsTestJSON-268458836 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:42:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-c0e05ad3-02f4-452c-b912-f75ab084161b req-d5a94e40-3649-47cd-901d-4204fb62e406 tempest-VolumesSnapshotsTestJSON-268458836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:42:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-c0e05ad3-02f4-452c-b912-f75ab084161b req-d5a94e40-3649-47cd-901d-4204fb62e406 tempest-VolumesSnapshotsTestJSON-268458836 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:42:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-c0e05ad3-02f4-452c-b912-f75ab084161b req-d5a94e40-3649-47cd-901d-4204fb62e406 tempest-VolumesSnapshotsTestJSON-268458836 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.210s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:42:57 devstack cinder-volume[82594]: DEBUG cinder.manager [req-c0e05ad3-02f4-452c-b912-f75ab084161b req-d5a94e40-3649-47cd-901d-4204fb62e406 tempest-VolumesSnapshotsTestJSON-268458836 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:42:57 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-c0e05ad3-02f4-452c-b912-f75ab084161b req-d5a94e40-3649-47cd-901d-4204fb62e406 tempest-VolumesSnapshotsTestJSON-268458836 None] Deleted volume successfully.
Sep 10 11:42:58 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-c0e05ad3-02f4-452c-b912-f75ab084161b req-d5a94e40-3649-47cd-901d-4204fb62e406 tempest-VolumesSnapshotsTestJSON-268458836 None] Lock "cinder-ca6c95a0-63b0-4ad5-9352-d5bd2ce5bf49-delete_volume" released by "delete_volume" :: held 2.914s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:43:03 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Flow 'volume_create_manager' (7f4b2b3e-57b5-4c61-aa0f-3c4d28cf50b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e356919-4747-4827-a834-d35a5ddfc87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e356919-4747-4827-a834-d35a5ddfc87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1829032672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c4d9d5b-c7c0-41c3-9796-c0fb6128eb86,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c49b9fefed1493995c55a8c994d9daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:43:03Z,use_quota=True,user_id='090258cb7aca4e6894d1945349daa460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2411022-6847-41e9-b07b-e73b69e52311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2411022-6847-41e9-b07b-e73b69e52311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f695c6de-bf74-4f1c-be16-e7a3353efe25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f695c6de-bf74-4f1c-be16-e7a3353efe25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c4d9d5b-c7c0-41c3-9796-c0fb6128eb86', 'volume_name': 'volume-8c4d9d5b-c7c0-41c3-9796-c0fb6128eb86', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb93159-45c5-44a4-bceb-96802396ee63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb93159-45c5-44a4-bceb-96802396ee63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ef94d6-f7af-4b5e-abd6-2a0f576891d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:43:03 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Volume 8c4d9d5b-c7c0-41c3-9796-c0fb6128eb86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c4d9d5b-c7c0-41c3-9796-c0fb6128eb86', 'volume_size': 1}
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1829032672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c4d9d5b-c7c0-41c3-9796-c0fb6128eb86,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c49b9fefed1493995c55a8c994d9daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:43:03Z,use_quota=True,user_id='090258cb7aca4e6894d1945349daa460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Creating volume 8c4d9d5b-c7c0-41c3-9796-c0fb6128eb86 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:43:03 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8c4d9d5b-c7c0-41c3-9796-c0fb6128eb86 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:43:03 devstack quobyte-client[82616]: System call of process 91415 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:43:03 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=47, name=volume-8c4d9d5b-c7c0-41c3-9796-c0fb6128eb86, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:43:03 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-0a96ff7d-21fe-489d-8af6-be17fca4ba2e tempest-VolumesActionsTest-548721962 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0a96ff7d-21fe-489d-8af6-be17fca4ba2e tempest-VolumesActionsTest-548721962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8c4d9d5b-c7c0-41c3-9796-c0fb6128eb86 1073741824" returned: 0 in 0.419s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8c4d9d5b-c7c0-41c3-9796-c0fb6128eb86 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8c4d9d5b-c7c0-41c3-9796-c0fb6128eb86" returned: 0 in 0.113s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] <== create_volume: return (577ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:43:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.589s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:43:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0a96ff7d-21fe-489d-8af6-be17fca4ba2e tempest-VolumesActionsTest-548721962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.521s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:43:04 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f78afed-8a15-431b-a988-83e54879ebc1]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:43:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0a96ff7d-21fe-489d-8af6-be17fca4ba2e tempest-VolumesActionsTest-548721962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-365d4ad3-b2e4-4942-84f3-496367c142a5 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:43:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ef94d6-f7af-4b5e-abd6-2a0f576891d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c4d9d5b-c7c0-41c3-9796-c0fb6128eb86', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:43:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26746646-d5fb-4ad8-a609-fd1b0ae95584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:43:04 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Volume volume-8c4d9d5b-c7c0-41c3-9796-c0fb6128eb86 (8c4d9d5b-c7c0-41c3-9796-c0fb6128eb86): created successfully
Sep 10 11:43:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26746646-d5fb-4ad8-a609-fd1b0ae95584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:43:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Flow 'volume_create_manager' (7f4b2b3e-57b5-4c61-aa0f-3c4d28cf50b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:43:04 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-5e2e0073-8e84-48b6-b0af-e01db4e2f073 req-617f5e43-fe0d-4fbc-a29e-3bc777925f85 tempest-VolumesGetTestJSON-791117937 None] Created volume successfully.
Sep 10 11:43:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0a96ff7d-21fe-489d-8af6-be17fca4ba2e tempest-VolumesActionsTest-548721962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-365d4ad3-b2e4-4942-84f3-496367c142a5" returned: 0 in 0.711s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:43:04 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0e3363-c4e7-4550-8dba-15633c3e9b8a]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:43:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0a96ff7d-21fe-489d-8af6-be17fca4ba2e tempest-VolumesActionsTest-548721962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-365d4ad3-b2e4-4942-84f3-496367c142a5 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:43:05 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-27c039a2-f067-4d65-b729-ed984f4cf77b req-5e0b9424-9837-4da3-b942-564e632cdef3 tempest-VolumesGetTestJSON-791117937 None] Acquiring lock "cinder-8c4d9d5b-c7c0-41c3-9796-c0fb6128eb86-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:43:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0a96ff7d-21fe-489d-8af6-be17fca4ba2e tempest-VolumesActionsTest-548721962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-365d4ad3-b2e4-4942-84f3-496367c142a5" returned: 0 in 0.812s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:43:05 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-27c039a2-f067-4d65-b729-ed984f4cf77b req-5e0b9424-9837-4da3-b942-564e632cdef3 tempest-VolumesGetTestJSON-791117937 None] Lock "cinder-8c4d9d5b-c7c0-41c3-9796-c0fb6128eb86-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:43:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0a96ff7d-21fe-489d-8af6-be17fca4ba2e tempest-VolumesActionsTest-548721962 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-365d4ad3-b2e4-4942-84f3-496367c142a5 /opt/stack/data/cinder/conversion/365d4ad3-b2e4-4942-84f3-496367c142a5.temp_image.e85b4420-4cf1-4e7a-a5d2-f22fb7fd9df6jpegbc3g.img {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:43:06 devstack quobyte-client[82616]: System call of process 91425 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:43:06 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-27c039a2-f067-4d65-b729-ed984f4cf77b req-5e0b9424-9837-4da3-b942-564e632cdef3 tempest-VolumesGetTestJSON-791117937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:43:06 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-27c039a2-f067-4d65-b729-ed984f4cf77b req-5e0b9424-9837-4da3-b942-564e632cdef3 tempest-VolumesGetTestJSON-791117937 None] Acquiring lock "cinder-quobyte-8c4d9d5b-c7c0-41c3-9796-c0fb6128eb86" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:43:07 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-27c039a2-f067-4d65-b729-ed984f4cf77b req-5e0b9424-9837-4da3-b942-564e632cdef3 tempest-VolumesGetTestJSON-791117937 None] Lock "cinder-quobyte-8c4d9d5b-c7c0-41c3-9796-c0fb6128eb86" acquired by "delete_volume" :: waited 0.419s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:43:07 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02c3fd1-3d35-4dd4-b868-f1e6494aaf15]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:43:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-27c039a2-f067-4d65-b729-ed984f4cf77b req-5e0b9424-9837-4da3-b942-564e632cdef3 tempest-VolumesGetTestJSON-791117937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8c4d9d5b-c7c0-41c3-9796-c0fb6128eb86 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:43:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-27c039a2-f067-4d65-b729-ed984f4cf77b req-5e0b9424-9837-4da3-b942-564e632cdef3 tempest-VolumesGetTestJSON-791117937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8c4d9d5b-c7c0-41c3-9796-c0fb6128eb86" returned: 0 in 2.689s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:43:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-27c039a2-f067-4d65-b729-ed984f4cf77b req-5e0b9424-9837-4da3-b942-564e632cdef3 tempest-VolumesGetTestJSON-791117937 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8c4d9d5b-c7c0-41c3-9796-c0fb6128eb86 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:43:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-27c039a2-f067-4d65-b729-ed984f4cf77b req-5e0b9424-9837-4da3-b942-564e632cdef3 tempest-VolumesGetTestJSON-791117937 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8c4d9d5b-c7c0-41c3-9796-c0fb6128eb86" returned: 0 in 1.076s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:43:12 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-27c039a2-f067-4d65-b729-ed984f4cf77b req-5e0b9424-9837-4da3-b942-564e632cdef3 tempest-VolumesGetTestJSON-791117937 None] Lock "cinder-quobyte-8c4d9d5b-c7c0-41c3-9796-c0fb6128eb86" released by "delete_volume" :: held 5.135s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:43:15 devstack cinder-volume[82594]: DEBUG cinder.quota [req-27c039a2-f067-4d65-b729-ed984f4cf77b req-5e0b9424-9837-4da3-b942-564e632cdef3 tempest-VolumesGetTestJSON-791117937 None] Created reservations ['9426e0a1-4d80-49c0-8035-5179ad4760fe', 'e07f2a95-7c36-40ee-a18a-fc67bddd32c8', 'd21ddd56-d341-4623-8b1a-5f8a90ee2d89', 'a06d010c-72ae-4f4d-bf89-06411c040c70'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:43:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-27c039a2-f067-4d65-b729-ed984f4cf77b req-5e0b9424-9837-4da3-b942-564e632cdef3 tempest-VolumesGetTestJSON-791117937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:43:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-27c039a2-f067-4d65-b729-ed984f4cf77b req-5e0b9424-9837-4da3-b942-564e632cdef3 tempest-VolumesGetTestJSON-791117937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:43:16 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [req-27c039a2-f067-4d65-b729-ed984f4cf77b req-5e0b9424-9837-4da3-b942-564e632cdef3 tempest-VolumesGetTestJSON-791117937 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:43:16 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [req-27c039a2-f067-4d65-b729-ed984f4cf77b req-5e0b9424-9837-4da3-b942-564e632cdef3 tempest-VolumesGetTestJSON-791117937 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:43:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-27c039a2-f067-4d65-b729-ed984f4cf77b req-5e0b9424-9837-4da3-b942-564e632cdef3 tempest-VolumesGetTestJSON-791117937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.092s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:43:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-27c039a2-f067-4d65-b729-ed984f4cf77b req-5e0b9424-9837-4da3-b942-564e632cdef3 tempest-VolumesGetTestJSON-791117937 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:43:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-27c039a2-f067-4d65-b729-ed984f4cf77b req-5e0b9424-9837-4da3-b942-564e632cdef3 tempest-VolumesGetTestJSON-791117937 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.553s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:43:16 devstack cinder-volume[82594]: DEBUG cinder.manager [req-27c039a2-f067-4d65-b729-ed984f4cf77b req-5e0b9424-9837-4da3-b942-564e632cdef3 tempest-VolumesGetTestJSON-791117937 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:43:17 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-27c039a2-f067-4d65-b729-ed984f4cf77b req-5e0b9424-9837-4da3-b942-564e632cdef3 tempest-VolumesGetTestJSON-791117937 None] Deleted volume successfully.
Sep 10 11:43:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0a96ff7d-21fe-489d-8af6-be17fca4ba2e tempest-VolumesActionsTest-548721962 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-365d4ad3-b2e4-4942-84f3-496367c142a5 /opt/stack/data/cinder/conversion/365d4ad3-b2e4-4942-84f3-496367c142a5.temp_image.e85b4420-4cf1-4e7a-a5d2-f22fb7fd9df6jpegbc3g.img" returned: 0 in 11.579s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:43:17 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d113b986-91ff-4423-b2e3-e7c72e29fb6c]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:43:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0a96ff7d-21fe-489d-8af6-be17fca4ba2e tempest-VolumesActionsTest-548721962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-365d4ad3-b2e4-4942-84f3-496367c142a5 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:43:17 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-27c039a2-f067-4d65-b729-ed984f4cf77b req-5e0b9424-9837-4da3-b942-564e632cdef3 tempest-VolumesGetTestJSON-791117937 None] Lock "cinder-8c4d9d5b-c7c0-41c3-9796-c0fb6128eb86-delete_volume" released by "delete_volume" :: held 12.080s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:43:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0a96ff7d-21fe-489d-8af6-be17fca4ba2e tempest-VolumesActionsTest-548721962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-365d4ad3-b2e4-4942-84f3-496367c142a5" returned: 0 in 1.208s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:43:18 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-0a96ff7d-21fe-489d-8af6-be17fca4ba2e tempest-VolumesActionsTest-548721962 None] Image conversion details: src /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-365d4ad3-b2e4-4942-84f3-496367c142a5, size 1024.00 MB, duration 11.59 sec, destination /opt/stack/data/cinder/conversion/365d4ad3-b2e4-4942-84f3-496367c142a5.temp_image.e85b4420-4cf1-4e7a-a5d2-f22fb7fd9df6jpegbc3g.img {{(pid=82594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 11:43:18 devstack cinder-volume[82594]: INFO cinder.image.image_utils [None req-0a96ff7d-21fe-489d-8af6-be17fca4ba2e tempest-VolumesActionsTest-548721962 None] Converted 1024.00 MB image at 88.37 MB/s
Sep 10 11:43:19 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-0a96ff7d-21fe-489d-8af6-be17fca4ba2e tempest-VolumesActionsTest-548721962 None] e85b4420-4cf1-4e7a-a5d2-f22fb7fd9df6 was raw, no need to convert to raw {{(pid=82594) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}}
Sep 10 11:43:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:43:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:43:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:43:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:43:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:43:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:43:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:43:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.275s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:43:22 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:43:29 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=36,cinder:SELECT=30,cinder:DELETE=2,cinder:INSERT=10 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:43:29 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=22,cinder:UPDATE=23,cinder:DELETE=3,cinder:INSERT=4 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:43:45 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-a5954830-ab4c-4427-beac-865ff6128b72 tempest-GroupsTest-610565593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:43:45 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-a5954830-ab4c-4427-beac-865ff6128b72 tempest-GroupsTest-610565593 None] Group tempest-Group1-1995782062: creating
Sep 10 11:43:45 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-a5954830-ab4c-4427-beac-865ff6128b72 tempest-GroupsTest-610565593 None] Group tempest-Group1-1995782062: created successfully
Sep 10 11:43:45 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-a5954830-ab4c-4427-beac-865ff6128b72 tempest-GroupsTest-610565593 None] Create group completed successfully.
Sep 10 11:43:46 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-b6f97bcb-9feb-4e01-b32d-79e40ca50db7 tempest-GroupsTest-610565593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:43:46 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-b6f97bcb-9feb-4e01-b32d-79e40ca50db7 tempest-GroupsTest-610565593 None] Group tempest-Group2-154820265: creating
Sep 10 11:43:47 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-b6f97bcb-9feb-4e01-b32d-79e40ca50db7 tempest-GroupsTest-610565593 None] Group tempest-Group2-154820265: created successfully
Sep 10 11:43:47 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-b6f97bcb-9feb-4e01-b32d-79e40ca50db7 tempest-GroupsTest-610565593 None] Create group completed successfully.
Sep 10 11:43:49 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:43:49 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:43:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Flow 'volume_create_manager' (b175263f-e399-4525-a094-0e18ab6d7ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:43:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4993c223-c974-47ac-85af-bf6666f500d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:43:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4993c223-c974-47ac-85af-bf6666f500d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1810764092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eb21088b-e9f4-4306-af9f-4c41985411d4,host='devstack@QuobyteHD#QuobyteHD',id=2cfbe3b1-41a6-41e6-9ea4-b89e7b29841c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f9339a6b794fb9ac3897c358851cdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:43:49Z,use_quota=True,user_id='cdac07f95a5a409da15e844a3aaff151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81080256-d06b-4e33-885e-b5295580a81a),volume_type_id=81080256-d06b-4e33-885e-b5295580a81a)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:43:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6debe50b-273b-48fa-bd25-64e6324832e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:43:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6debe50b-273b-48fa-bd25-64e6324832e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:43:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b05d604-fec3-4f86-9913-dc957d5fc0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:43:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b05d604-fec3-4f86-9913-dc957d5fc0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cfbe3b1-41a6-41e6-9ea4-b89e7b29841c', 'volume_name': 'volume-2cfbe3b1-41a6-41e6-9ea4-b89e7b29841c', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:43:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d8009c6-9fce-4a1f-a964-2c9b286d149c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:43:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d8009c6-9fce-4a1f-a964-2c9b286d149c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:43:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4774f1a-6e9b-4955-a896-1da0f4323169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:43:49 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Volume 2cfbe3b1-41a6-41e6-9ea4-b89e7b29841c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cfbe3b1-41a6-41e6-9ea4-b89e7b29841c', 'volume_size': 1}
Sep 10 11:43:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:43:59 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-20de8a1d-8448-4909-9655-2f2e5330bf3c req-352aa409-9b6e-426f-95b2-0eba237c0d25 tempest-AttachVolumeNegativeTest-1236938792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:43:59 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-20de8a1d-8448-4909-9655-2f2e5330bf3c req-352aa409-9b6e-426f-95b2-0eba237c0d25 tempest-AttachVolumeNegativeTest-1236938792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:43:59 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-20de8a1d-8448-4909-9655-2f2e5330bf3c req-352aa409-9b6e-426f-95b2-0eba237c0d25 tempest-AttachVolumeNegativeTest-1236938792 None] Terminate volume connection completed successfully.
Sep 10 11:43:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-20de8a1d-8448-4909-9655-2f2e5330bf3c req-352aa409-9b6e-426f-95b2-0eba237c0d25 tempest-AttachVolumeNegativeTest-1236938792 None] Deleting attachment ef272e43-5622-4042-9388-aa788e1b937d. {{(pid=82594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 11:43:59 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:44:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0a96ff7d-21fe-489d-8af6-be17fca4ba2e tempest-VolumesActionsTest-548721962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 67.684s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:44:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0a96ff7d-21fe-489d-8af6-be17fca4ba2e tempest-VolumesActionsTest-548721962 None] Uploaded volume to glance image-id: e85b4420-4cf1-4e7a-a5d2-f22fb7fd9df6. {{(pid=82594) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 10 11:44:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.380s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:44:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=eb21088b-e9f4-4306-af9f-4c41985411d4,created_at=2025-09-10T09:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1810764092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eb21088b-e9f4-4306-af9f-4c41985411d4,host='devstack@QuobyteHD#QuobyteHD',id=2cfbe3b1-41a6-41e6-9ea4-b89e7b29841c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f9339a6b794fb9ac3897c358851cdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:43:49Z,use_quota=True,user_id='cdac07f95a5a409da15e844a3aaff151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81080256-d06b-4e33-885e-b5295580a81a),volume_type_id=81080256-d06b-4e33-885e-b5295580a81a)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:44:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Creating volume 2cfbe3b1-41a6-41e6-9ea4-b89e7b29841c {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:44:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:44:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:44:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:44:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:44:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:44:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:44:11 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:44:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2cfbe3b1-41a6-41e6-9ea4-b89e7b29841c 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:11 devstack quobyte-client[82616]: System call of process 91624 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:44:11 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=48, name=volume-2cfbe3b1-41a6-41e6-9ea4-b89e7b29841c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:44:12 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-0a96ff7d-21fe-489d-8af6-be17fca4ba2e tempest-VolumesActionsTest-548721962 None] Copy volume to image completed successfully.
Sep 10 11:44:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2cfbe3b1-41a6-41e6-9ea4-b89e7b29841c 1073741824" returned: 0 in 0.520s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2cfbe3b1-41a6-41e6-9ea4-b89e7b29841c {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2cfbe3b1-41a6-41e6-9ea4-b89e7b29841c" returned: 0 in 0.100s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:12 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] <== create_volume: return (680ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:44:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:44:12 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4774f1a-6e9b-4955-a896-1da0f4323169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cfbe3b1-41a6-41e6-9ea4-b89e7b29841c', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:44:12 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea13cece-dbe4-431c-8e88-6333810a34c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:44:12 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Volume volume-2cfbe3b1-41a6-41e6-9ea4-b89e7b29841c (2cfbe3b1-41a6-41e6-9ea4-b89e7b29841c): created successfully
Sep 10 11:44:12 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea13cece-dbe4-431c-8e88-6333810a34c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:44:12 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Flow 'volume_create_manager' (b175263f-e399-4525-a094-0e18ab6d7ca2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:44:12 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-edc4c2d3-29f9-4365-8098-16c309623949 tempest-GroupsTest-610565593 None] Created volume successfully.
Sep 10 11:44:13 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-1aa960ba-a6c9-4e27-b3e7-2283c0ed6aa1 tempest-GroupsTest-610565593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:44:14 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1aa960ba-a6c9-4e27-b3e7-2283c0ed6aa1 tempest-GroupsTest-610565593 None] Acquiring lock "cinder-quobyte-2cfbe3b1-41a6-41e6-9ea4-b89e7b29841c" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:44:14 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1aa960ba-a6c9-4e27-b3e7-2283c0ed6aa1 tempest-GroupsTest-610565593 None] Lock "cinder-quobyte-2cfbe3b1-41a6-41e6-9ea4-b89e7b29841c" acquired by "delete_volume" :: waited 0.063s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:44:14 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0064a471-abc8-407e-84c6-bfc40eebf265]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:44:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1aa960ba-a6c9-4e27-b3e7-2283c0ed6aa1 tempest-GroupsTest-610565593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2cfbe3b1-41a6-41e6-9ea4-b89e7b29841c {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:14 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:44:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:44:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:44:14 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[125b29d6-970e-4bc0-a341-935ab0f2e247]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:44:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1aa960ba-a6c9-4e27-b3e7-2283c0ed6aa1 tempest-GroupsTest-610565593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2cfbe3b1-41a6-41e6-9ea4-b89e7b29841c" returned: 0 in 0.668s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-365d4ad3-b2e4-4942-84f3-496367c142a5 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1aa960ba-a6c9-4e27-b3e7-2283c0ed6aa1 tempest-GroupsTest-610565593 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2cfbe3b1-41a6-41e6-9ea4-b89e7b29841c {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1aa960ba-a6c9-4e27-b3e7-2283c0ed6aa1 tempest-GroupsTest-610565593 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2cfbe3b1-41a6-41e6-9ea4-b89e7b29841c" returned: 0 in 0.221s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:15 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1aa960ba-a6c9-4e27-b3e7-2283c0ed6aa1 tempest-GroupsTest-610565593 None] Lock "cinder-quobyte-2cfbe3b1-41a6-41e6-9ea4-b89e7b29841c" released by "delete_volume" :: held 1.230s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:44:15 devstack quobyte-client[82616]: System call of process 91631 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:44:15 devstack quobyte-client[82616]: System call of process 91631 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:44:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-365d4ad3-b2e4-4942-84f3-496367c142a5" returned: 0 in 0.854s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:15 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e268b00-e1f4-40aa-a003-81b891fb3945]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:44:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-365d4ad3-b2e4-4942-84f3-496367c142a5 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:16 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-1aa960ba-a6c9-4e27-b3e7-2283c0ed6aa1 tempest-GroupsTest-610565593 None] Created reservations ['98a72261-abec-4a8a-bdcc-80077ee9f5da'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:44:16 devstack cinder-volume[82594]: WARNING cinder.quota [None req-1aa960ba-a6c9-4e27-b3e7-2283c0ed6aa1 tempest-GroupsTest-610565593 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-333039602 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-333039602, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:44:16 devstack cinder-volume[82594]: WARNING cinder.quota [None req-1aa960ba-a6c9-4e27-b3e7-2283c0ed6aa1 tempest-GroupsTest-610565593 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-333039602 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-333039602, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:44:16 devstack quobyte-client[82616]: System call of process 91635 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:44:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-365d4ad3-b2e4-4942-84f3-496367c142a5" returned: 0 in 0.624s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-365d4ad3-b2e4-4942-84f3-496367c142a5 /opt/stack/data/cinder/conversion/365d4ad3-b2e4-4942-84f3-496367c142a5.temp_image.b161e098-ef11-4b30-ac14-ef89ddaabf69zdv9rdvq.img {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:16 devstack quobyte-client[82616]: System call of process 91638 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:44:16 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-1aa960ba-a6c9-4e27-b3e7-2283c0ed6aa1 tempest-GroupsTest-610565593 None] Created reservations ['20698f8e-9656-4c4c-a745-599254bec6f7', '71b7590b-44ee-437f-9952-ca1a70ffb01d', 'b5438ef4-d1ca-4a9e-828a-9a31668dfcb8', '7662c684-6b14-411c-b408-701bc9c2e51a'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:44:16 devstack quobyte-client[82616]: System call of process 91638 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:44:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1aa960ba-a6c9-4e27-b3e7-2283c0ed6aa1 tempest-GroupsTest-610565593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:44:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1aa960ba-a6c9-4e27-b3e7-2283c0ed6aa1 tempest-GroupsTest-610565593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:44:17 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1aa960ba-a6c9-4e27-b3e7-2283c0ed6aa1 tempest-GroupsTest-610565593 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:44:17 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1aa960ba-a6c9-4e27-b3e7-2283c0ed6aa1 tempest-GroupsTest-610565593 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:44:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1aa960ba-a6c9-4e27-b3e7-2283c0ed6aa1 tempest-GroupsTest-610565593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:44:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1aa960ba-a6c9-4e27-b3e7-2283c0ed6aa1 tempest-GroupsTest-610565593 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1aa960ba-a6c9-4e27-b3e7-2283c0ed6aa1 tempest-GroupsTest-610565593 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.413s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:18 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-1aa960ba-a6c9-4e27-b3e7-2283c0ed6aa1 tempest-GroupsTest-610565593 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:44:18 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-1aa960ba-a6c9-4e27-b3e7-2283c0ed6aa1 tempest-GroupsTest-610565593 None] Delete group completed successfully.
Sep 10 11:44:18 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-d52f6c2a-37c6-41e0-ad6f-67558c636f02 tempest-GroupsTest-610565593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:44:19 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-d52f6c2a-37c6-41e0-ad6f-67558c636f02 tempest-GroupsTest-610565593 None] Created reservations ['cc0c7583-f1a8-4d98-abbd-392ab79c6134'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:44:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d52f6c2a-37c6-41e0-ad6f-67558c636f02 tempest-GroupsTest-610565593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:44:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d52f6c2a-37c6-41e0-ad6f-67558c636f02 tempest-GroupsTest-610565593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.070s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:44:19 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d52f6c2a-37c6-41e0-ad6f-67558c636f02 tempest-GroupsTest-610565593 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:44:19 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d52f6c2a-37c6-41e0-ad6f-67558c636f02 tempest-GroupsTest-610565593 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:44:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d52f6c2a-37c6-41e0-ad6f-67558c636f02 tempest-GroupsTest-610565593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.071s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:44:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d52f6c2a-37c6-41e0-ad6f-67558c636f02 tempest-GroupsTest-610565593 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d52f6c2a-37c6-41e0-ad6f-67558c636f02 tempest-GroupsTest-610565593 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.514s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:20 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-d52f6c2a-37c6-41e0-ad6f-67558c636f02 tempest-GroupsTest-610565593 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:44:20 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-d52f6c2a-37c6-41e0-ad6f-67558c636f02 tempest-GroupsTest-610565593 None] Delete group completed successfully.
Sep 10 11:44:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:44:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:44:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.030s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:44:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:44:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:44:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.182s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:44:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.713s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:23 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:44:24 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-dc83b3f2-afd7-44a0-9d5a-85216c459fb7 tempest-GroupsTest-610565593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:44:24 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-dc83b3f2-afd7-44a0-9d5a-85216c459fb7 tempest-GroupsTest-610565593 None] Group tempest-GroupsTest-Group-2071278559: creating
Sep 10 11:44:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-365d4ad3-b2e4-4942-84f3-496367c142a5 /opt/stack/data/cinder/conversion/365d4ad3-b2e4-4942-84f3-496367c142a5.temp_image.b161e098-ef11-4b30-ac14-ef89ddaabf69zdv9rdvq.img" returned: 0 in 8.618s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:25 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[796c5bf4-11e8-4ea2-9785-6f5959e3bce1]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:44:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-365d4ad3-b2e4-4942-84f3-496367c142a5 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:25 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-dc83b3f2-afd7-44a0-9d5a-85216c459fb7 tempest-GroupsTest-610565593 None] Group tempest-GroupsTest-Group-2071278559: created successfully
Sep 10 11:44:25 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-dc83b3f2-afd7-44a0-9d5a-85216c459fb7 tempest-GroupsTest-610565593 None] Create group completed successfully.
Sep 10 11:44:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-365d4ad3-b2e4-4942-84f3-496367c142a5" returned: 0 in 0.882s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:25 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] Image conversion details: src /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-365d4ad3-b2e4-4942-84f3-496367c142a5, size 1024.00 MB, duration 8.62 sec, destination /opt/stack/data/cinder/conversion/365d4ad3-b2e4-4942-84f3-496367c142a5.temp_image.b161e098-ef11-4b30-ac14-ef89ddaabf69zdv9rdvq.img {{(pid=82594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 11:44:25 devstack cinder-volume[82594]: INFO cinder.image.image_utils [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] Converted 1024.00 MB image at 118.74 MB/s
Sep 10 11:44:25 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] b161e098-ef11-4b30-ac14-ef89ddaabf69 was raw, converting to qcow2 {{(pid=82594) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}}
Sep 10 11:44:25 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0e49ac-edee-4914-8b2e-ce991caa3230]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:44:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/365d4ad3-b2e4-4942-84f3-496367c142a5.temp_image.b161e098-ef11-4b30-ac14-ef89ddaabf69zdv9rdvq.img {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/365d4ad3-b2e4-4942-84f3-496367c142a5.temp_image.b161e098-ef11-4b30-ac14-ef89ddaabf69zdv9rdvq.img" returned: 0 in 0.446s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/365d4ad3-b2e4-4942-84f3-496367c142a5.temp_image.b161e098-ef11-4b30-ac14-ef89ddaabf69zdv9rdvq.img {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/365d4ad3-b2e4-4942-84f3-496367c142a5.temp_image.b161e098-ef11-4b30-ac14-ef89ddaabf69zdv9rdvq.img" returned: 1 in 0.618s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/365d4ad3-b2e4-4942-84f3-496367c142a5.temp_image.b161e098-ef11-4b30-ac14-ef89ddaabf69zdv9rdvq.img' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 11:44:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/365d4ad3-b2e4-4942-84f3-496367c142a5.temp_image.b161e098-ef11-4b30-ac14-ef89ddaabf69zdv9rdvq.img /opt/stack/data/cinder/conversion/vol_upload_6kvb09fp {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/365d4ad3-b2e4-4942-84f3-496367c142a5.temp_image.b161e098-ef11-4b30-ac14-ef89ddaabf69zdv9rdvq.img /opt/stack/data/cinder/conversion/vol_upload_6kvb09fp" returned: 0 in 0.442s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:27 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] Image conversion details: src /opt/stack/data/cinder/conversion/365d4ad3-b2e4-4942-84f3-496367c142a5.temp_image.b161e098-ef11-4b30-ac14-ef89ddaabf69zdv9rdvq.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_6kvb09fp {{(pid=82594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 11:44:27 devstack cinder-volume[82594]: INFO cinder.image.image_utils [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 10 11:44:27 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd29fe2b-fedc-4815-98c1-80c24b62c678]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:44:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6kvb09fp {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:27 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:44:27 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:44:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Flow 'volume_create_manager' (6240d50a-04c4-47ea-b392-a375e2b65172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:44:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c21c72-e132-4274-80bf-649ef9873243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:44:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c21c72-e132-4274-80bf-649ef9873243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1596083814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5bc9be30-dfcf-4542-b8d9-d6742bf93ac0,host='devstack@QuobyteHD#QuobyteHD',id=9e330037-fe12-491c-856c-958340e0d648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f9339a6b794fb9ac3897c358851cdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:44:27Z,use_quota=True,user_id='cdac07f95a5a409da15e844a3aaff151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2678ca5f-0548-4bb3-a9bd-f5748c00f73c),volume_type_id=2678ca5f-0548-4bb3-a9bd-f5748c00f73c)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:44:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e9167d-73d0-4715-a88d-3d7566ecd81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:44:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e9167d-73d0-4715-a88d-3d7566ecd81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:44:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d9d07a-d678-445e-9464-718b81be6ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:44:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d9d07a-d678-445e-9464-718b81be6ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e330037-fe12-491c-856c-958340e0d648', 'volume_name': 'volume-9e330037-fe12-491c-856c-958340e0d648', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:44:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd81c564-8d53-4bc6-9c40-96771c9b0092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:44:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd81c564-8d53-4bc6-9c40-96771c9b0092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:44:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9918598d-47fe-4c64-a52d-eb065c79a611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:44:28 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Volume 9e330037-fe12-491c-856c-958340e0d648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e330037-fe12-491c-856c-958340e0d648', 'volume_size': 1}
Sep 10 11:44:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:44:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6kvb09fp" returned: 0 in 0.591s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.041s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:44:29 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] Uploaded volume to glance image-id: b161e098-ef11-4b30-ac14-ef89ddaabf69. {{(pid=82594) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 10 11:44:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.605s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:44:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5bc9be30-dfcf-4542-b8d9-d6742bf93ac0,created_at=2025-09-10T09:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1596083814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5bc9be30-dfcf-4542-b8d9-d6742bf93ac0,host='devstack@QuobyteHD#QuobyteHD',id=9e330037-fe12-491c-856c-958340e0d648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f9339a6b794fb9ac3897c358851cdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:44:27Z,use_quota=True,user_id='cdac07f95a5a409da15e844a3aaff151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2678ca5f-0548-4bb3-a9bd-f5748c00f73c),volume_type_id=2678ca5f-0548-4bb3-a9bd-f5748c00f73c)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:44:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Creating volume 9e330037-fe12-491c-856c-958340e0d648 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:44:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:44:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:44:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:44:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:44:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:44:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:44:29 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:44:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9e330037-fe12-491c-856c-958340e0d648 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:29 devstack quobyte-client[82616]: System call of process 91675 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:44:29 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=49, name=volume-9e330037-fe12-491c-856c-958340e0d648, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:44:30 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-da005518-020f-4741-af9b-b95bc12bc6a3 tempest-VolumesActionsTest-548721962 None] Copy volume to image completed successfully.
Sep 10 11:44:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9e330037-fe12-491c-856c-958340e0d648 1073741824" returned: 0 in 0.426s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9e330037-fe12-491c-856c-958340e0d648 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9e330037-fe12-491c-856c-958340e0d648" returned: 0 in 0.120s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:30 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] <== create_volume: return (605ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:44:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.621s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:44:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9918598d-47fe-4c64-a52d-eb065c79a611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e330037-fe12-491c-856c-958340e0d648', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:44:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd3e310-e16c-4a10-965c-ea1fb91f65b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:44:30 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Volume volume-9e330037-fe12-491c-856c-958340e0d648 (9e330037-fe12-491c-856c-958340e0d648): created successfully
Sep 10 11:44:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd3e310-e16c-4a10-965c-ea1fb91f65b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:44:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Flow 'volume_create_manager' (6240d50a-04c4-47ea-b392-a375e2b65172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:44:30 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-de0f3db9-d5ed-4e39-9f23-b279211089f0 tempest-GroupsTest-610565593 None] Created volume successfully.
Sep 10 11:44:32 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e33e2a12-e245-4e0a-8626-35e193875b7f tempest-VolumesActionsTest-548721962 None] Acquiring lock "cinder-365d4ad3-b2e4-4942-84f3-496367c142a5-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:44:32 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e33e2a12-e245-4e0a-8626-35e193875b7f tempest-VolumesActionsTest-548721962 None] Lock "cinder-365d4ad3-b2e4-4942-84f3-496367c142a5-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:44:33 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-e33e2a12-e245-4e0a-8626-35e193875b7f tempest-VolumesActionsTest-548721962 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:44:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e33e2a12-e245-4e0a-8626-35e193875b7f tempest-VolumesActionsTest-548721962 None] Acquiring lock "cinder-quobyte-365d4ad3-b2e4-4942-84f3-496367c142a5" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:44:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e33e2a12-e245-4e0a-8626-35e193875b7f tempest-VolumesActionsTest-548721962 None] Lock "cinder-quobyte-365d4ad3-b2e4-4942-84f3-496367c142a5" acquired by "delete_volume" :: waited 0.031s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:44:33 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc854a6c-9fdb-485f-b6a4-3e83e4e7f352]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:44:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e33e2a12-e245-4e0a-8626-35e193875b7f tempest-VolumesActionsTest-548721962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-365d4ad3-b2e4-4942-84f3-496367c142a5 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e33e2a12-e245-4e0a-8626-35e193875b7f tempest-VolumesActionsTest-548721962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-365d4ad3-b2e4-4942-84f3-496367c142a5" returned: 0 in 0.437s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e33e2a12-e245-4e0a-8626-35e193875b7f tempest-VolumesActionsTest-548721962 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-365d4ad3-b2e4-4942-84f3-496367c142a5 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e33e2a12-e245-4e0a-8626-35e193875b7f tempest-VolumesActionsTest-548721962 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-365d4ad3-b2e4-4942-84f3-496367c142a5" returned: 0 in 0.081s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e33e2a12-e245-4e0a-8626-35e193875b7f tempest-VolumesActionsTest-548721962 None] Lock "cinder-quobyte-365d4ad3-b2e4-4942-84f3-496367c142a5" released by "delete_volume" :: held 0.675s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:44:34 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-e33e2a12-e245-4e0a-8626-35e193875b7f tempest-VolumesActionsTest-548721962 None] Created reservations ['ad221891-0f02-4e0c-a5ce-a66d383fe76f', '76eb8453-8e7d-43ed-8ed1-9a6c1823440d', '86674afb-9929-437b-8356-5d884e52d814', 'bd3074aa-e0fa-44b6-a116-8045082da3ae'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:44:35 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:44:35 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:44:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Flow 'volume_create_manager' (15ca4a9a-6118-452f-9db7-4361c7cbc43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:44:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8865c809-fe07-4bf5-8e71-cea4f2d619a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:44:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e33e2a12-e245-4e0a-8626-35e193875b7f tempest-VolumesActionsTest-548721962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:44:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e33e2a12-e245-4e0a-8626-35e193875b7f tempest-VolumesActionsTest-548721962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:44:35 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e33e2a12-e245-4e0a-8626-35e193875b7f tempest-VolumesActionsTest-548721962 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:44:35 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e33e2a12-e245-4e0a-8626-35e193875b7f tempest-VolumesActionsTest-548721962 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:44:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e33e2a12-e245-4e0a-8626-35e193875b7f tempest-VolumesActionsTest-548721962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:44:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e33e2a12-e245-4e0a-8626-35e193875b7f tempest-VolumesActionsTest-548721962 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8865c809-fe07-4bf5-8e71-cea4f2d619a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-494983303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5bc9be30-dfcf-4542-b8d9-d6742bf93ac0,host='devstack@QuobyteHD#QuobyteHD',id=a878b141-7bfc-4881-9d95-92b6142ac881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f9339a6b794fb9ac3897c358851cdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:44:35Z,use_quota=True,user_id='cdac07f95a5a409da15e844a3aaff151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2678ca5f-0548-4bb3-a9bd-f5748c00f73c),volume_type_id=2678ca5f-0548-4bb3-a9bd-f5748c00f73c)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:44:36 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b80977-61cd-414a-b75a-93b2feeec351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:44:36 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b80977-61cd-414a-b75a-93b2feeec351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:44:36 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ffaf3a2-0eef-4268-a3dd-921f618e88ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:44:36 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ffaf3a2-0eef-4268-a3dd-921f618e88ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a878b141-7bfc-4881-9d95-92b6142ac881', 'volume_name': 'volume-a878b141-7bfc-4881-9d95-92b6142ac881', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:44:36 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1fa2d2-7c2e-4658-b643-83951e2e11e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:44:36 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1fa2d2-7c2e-4658-b643-83951e2e11e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:44:36 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ed57e8-ec9f-4ceb-8c7f-5d1c21b8778b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:44:36 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Volume a878b141-7bfc-4881-9d95-92b6142ac881: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a878b141-7bfc-4881-9d95-92b6142ac881', 'volume_size': 1}
Sep 10 11:44:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:44:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:44:36 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5bc9be30-dfcf-4542-b8d9-d6742bf93ac0,created_at=2025-09-10T09:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-494983303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5bc9be30-dfcf-4542-b8d9-d6742bf93ac0,host='devstack@QuobyteHD#QuobyteHD',id=a878b141-7bfc-4881-9d95-92b6142ac881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f9339a6b794fb9ac3897c358851cdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:44:35Z,use_quota=True,user_id='cdac07f95a5a409da15e844a3aaff151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2678ca5f-0548-4bb3-a9bd-f5748c00f73c),volume_type_id=2678ca5f-0548-4bb3-a9bd-f5748c00f73c)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:44:36 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Creating volume a878b141-7bfc-4881-9d95-92b6142ac881 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:44:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:44:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:44:36 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:44:36 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:44:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:44:36 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:44:36 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:44:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a878b141-7bfc-4881-9d95-92b6142ac881 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:36 devstack quobyte-client[82616]: System call of process 91694 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:44:36 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=50, name=volume-a878b141-7bfc-4881-9d95-92b6142ac881, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:44:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e33e2a12-e245-4e0a-8626-35e193875b7f tempest-VolumesActionsTest-548721962 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 1.503s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:37 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-e33e2a12-e245-4e0a-8626-35e193875b7f tempest-VolumesActionsTest-548721962 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:44:37 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-e33e2a12-e245-4e0a-8626-35e193875b7f tempest-VolumesActionsTest-548721962 None] Deleted volume successfully.
Sep 10 11:44:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a878b141-7bfc-4881-9d95-92b6142ac881 1073741824" returned: 0 in 1.638s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a878b141-7bfc-4881-9d95-92b6142ac881 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:38 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e33e2a12-e245-4e0a-8626-35e193875b7f tempest-VolumesActionsTest-548721962 None] Lock "cinder-365d4ad3-b2e4-4942-84f3-496367c142a5-delete_volume" released by "delete_volume" :: held 5.723s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:44:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a878b141-7bfc-4881-9d95-92b6142ac881" returned: 0 in 0.584s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:38 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] <== create_volume: return (2296ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:44:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.354s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:44:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ed57e8-ec9f-4ceb-8c7f-5d1c21b8778b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a878b141-7bfc-4881-9d95-92b6142ac881', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:44:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672c740e-d655-456c-8ce8-ead3972dbef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:44:39 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Volume volume-a878b141-7bfc-4881-9d95-92b6142ac881 (a878b141-7bfc-4881-9d95-92b6142ac881): created successfully
Sep 10 11:44:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672c740e-d655-456c-8ce8-ead3972dbef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:44:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Flow 'volume_create_manager' (15ca4a9a-6118-452f-9db7-4361c7cbc43a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:44:39 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-a8a36b9f-8837-4902-8cbe-52518c118467 tempest-GroupsTest-610565593 None] Created volume successfully.
Sep 10 11:44:40 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=31,cinder:UPDATE=33,cinder:DELETE=1,cinder:INSERT=8 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:44:40 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-59622909-098c-42cb-8424-c30f6de9da51 tempest-GroupsTest-610565593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:44:40 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-59622909-098c-42cb-8424-c30f6de9da51 tempest-GroupsTest-610565593 None] Update group completed successfully.
Sep 10 11:44:42 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-069f1144-b517-4236-b3a9-a3999f502cc9 tempest-GroupsTest-610565593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:44:42 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-069f1144-b517-4236-b3a9-a3999f502cc9 tempest-GroupsTest-610565593 None] Update group completed successfully.
Sep 10 11:44:44 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:44:44 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] Acquiring lock "cinder-quobyte-9e330037-fe12-491c-856c-958340e0d648" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:44:44 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] Lock "cinder-quobyte-9e330037-fe12-491c-856c-958340e0d648" acquired by "delete_volume" :: waited 0.031s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:44:44 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a156469f-691d-4a38-b61e-30df69ac3fcb]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:44:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9e330037-fe12-491c-856c-958340e0d648 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9e330037-fe12-491c-856c-958340e0d648" returned: 0 in 0.589s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9e330037-fe12-491c-856c-958340e0d648 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9e330037-fe12-491c-856c-958340e0d648" returned: 0 in 0.152s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:45 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] Lock "cinder-quobyte-9e330037-fe12-491c-856c-958340e0d648" released by "delete_volume" :: held 0.969s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:44:45 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] Acquiring lock "cinder-quobyte-a878b141-7bfc-4881-9d95-92b6142ac881" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:44:45 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] Lock "cinder-quobyte-a878b141-7bfc-4881-9d95-92b6142ac881" acquired by "delete_volume" :: waited 0.033s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:44:45 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c439d1b0-14eb-4304-96d1-dff2e26e421b]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:44:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a878b141-7bfc-4881-9d95-92b6142ac881 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a878b141-7bfc-4881-9d95-92b6142ac881" returned: 0 in 0.650s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a878b141-7bfc-4881-9d95-92b6142ac881 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a878b141-7bfc-4881-9d95-92b6142ac881" returned: 0 in 0.120s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:46 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] Lock "cinder-quobyte-a878b141-7bfc-4881-9d95-92b6142ac881" released by "delete_volume" :: held 1.114s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:44:46 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] Created reservations ['3d260dee-31dd-478e-937c-fe59effd9ffa'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:44:47 devstack cinder-volume[82594]: WARNING cinder.quota [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-46825013 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-46825013, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:44:47 devstack cinder-volume[82594]: WARNING cinder.quota [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-46825013 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-46825013, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:44:47 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] Created reservations ['8195ec08-9d38-433a-8489-c9a45e1ed158', 'b2e92546-5380-49cd-8b0e-80e7b955e7c9', '3166222a-7578-46a7-b305-f0ae4928a3f6', 'c7222ce2-71cb-45ad-9f61-f454d93527eb'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:44:47 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] Created reservations ['f032a707-a3b1-4373-bef4-f0adb2a45985', '6fd45b26-5b1e-439c-9cb2-7d9b9a05a20a', '82173bb4-3b0f-4afa-800f-693db098ea44', '06234a35-a866-49a2-8404-9710ef2bb660'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:44:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:44:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:44:47 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:44:47 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:44:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:44:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.130s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:47 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:44:47 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-bc6d3acd-9873-46fb-9b99-ca0315165d07 tempest-GroupsTest-610565593 None] Delete group completed successfully.
Sep 10 11:44:52 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:44:52 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:44:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Flow 'volume_create_manager' (96506922-7d9d-44a7-8020-b1c8d640b027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:44:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ef75d8-1514-4cee-b1dd-836617fc5463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:44:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ef75d8-1514-4cee-b1dd-836617fc5463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-491421839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4a9c9a-038a-45eb-8b0f-07cc9c457fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2198428f189743daa4d66ca8bf60b338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:44:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:44:51Z,use_quota=True,user_id='6199ebfd8bdb44c6a95045322e099489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:44:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa992fca-cdb8-4b96-a595-19b86c468a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:44:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa992fca-cdb8-4b96-a595-19b86c468a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:44:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c92174-457d-4cd6-bc50-634a31ce2212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:44:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c92174-457d-4cd6-bc50-634a31ce2212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b4a9c9a-038a-45eb-8b0f-07cc9c457fa0', 'volume_name': 'volume-2b4a9c9a-038a-45eb-8b0f-07cc9c457fa0', 'volume_size': 2}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:44:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89916a58-3635-4744-910a-e043fb2f2717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:44:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89916a58-3635-4744-910a-e043fb2f2717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:44:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18af9726-4051-4b05-a007-8ff069bca8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:44:53 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Volume 2b4a9c9a-038a-45eb-8b0f-07cc9c457fa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b4a9c9a-038a-45eb-8b0f-07cc9c457fa0', 'volume_size': 2}
Sep 10 11:44:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:44:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.023s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:44:53 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-491421839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4a9c9a-038a-45eb-8b0f-07cc9c457fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2198428f189743daa4d66ca8bf60b338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:44:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:44:51Z,use_quota=True,user_id='6199ebfd8bdb44c6a95045322e099489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:44:53 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Creating volume 2b4a9c9a-038a-45eb-8b0f-07cc9c457fa0 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:44:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:44:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:44:53 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:44:53 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:44:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.068s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:44:53 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:44:53 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:44:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2b4a9c9a-038a-45eb-8b0f-07cc9c457fa0 2147483648 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:53 devstack quobyte-client[82616]: System call of process 91815 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:44:53 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=51, name=volume-2b4a9c9a-038a-45eb-8b0f-07cc9c457fa0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:44:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2b4a9c9a-038a-45eb-8b0f-07cc9c457fa0 2147483648" returned: 0 in 0.984s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2b4a9c9a-038a-45eb-8b0f-07cc9c457fa0 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2b4a9c9a-038a-45eb-8b0f-07cc9c457fa0" returned: 0 in 0.317s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:54 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] <== create_volume: return (1539ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:44:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:44:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18af9726-4051-4b05-a007-8ff069bca8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b4a9c9a-038a-45eb-8b0f-07cc9c457fa0', 'volume_size': 2}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:44:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7d146c8-c9ba-4ab5-898b-009568de8c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:44:55 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Volume volume-2b4a9c9a-038a-45eb-8b0f-07cc9c457fa0 (2b4a9c9a-038a-45eb-8b0f-07cc9c457fa0): created successfully
Sep 10 11:44:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7d146c8-c9ba-4ab5-898b-009568de8c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:44:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Flow 'volume_create_manager' (96506922-7d9d-44a7-8020-b1c8d640b027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:44:55 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-fc624b31-6161-41ad-a64b-2357033adee8 tempest-VolumesCloneNegativeTest-1879339350 None] Created volume successfully.
Sep 10 11:44:57 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-64df83af-d62a-4165-927b-b3cdf0551164 tempest-VolumesCloneNegativeTest-1879339350 None] Acquiring lock "cinder-2b4a9c9a-038a-45eb-8b0f-07cc9c457fa0-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:44:57 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-64df83af-d62a-4165-927b-b3cdf0551164 tempest-VolumesCloneNegativeTest-1879339350 None] Lock "cinder-2b4a9c9a-038a-45eb-8b0f-07cc9c457fa0-delete_volume" acquired by "delete_volume" :: waited 0.155s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:44:57 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-64df83af-d62a-4165-927b-b3cdf0551164 tempest-VolumesCloneNegativeTest-1879339350 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:44:57 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-64df83af-d62a-4165-927b-b3cdf0551164 tempest-VolumesCloneNegativeTest-1879339350 None] Acquiring lock "cinder-quobyte-2b4a9c9a-038a-45eb-8b0f-07cc9c457fa0" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:44:57 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-64df83af-d62a-4165-927b-b3cdf0551164 tempest-VolumesCloneNegativeTest-1879339350 None] Lock "cinder-quobyte-2b4a9c9a-038a-45eb-8b0f-07cc9c457fa0" acquired by "delete_volume" :: waited 0.036s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:44:57 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[db29c0f6-4dfe-4be0-80a4-b883d96a6e8b]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:44:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-64df83af-d62a-4165-927b-b3cdf0551164 tempest-VolumesCloneNegativeTest-1879339350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2b4a9c9a-038a-45eb-8b0f-07cc9c457fa0 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:58 devstack quobyte-client[82616]: System call of process 91836 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:44:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-64df83af-d62a-4165-927b-b3cdf0551164 tempest-VolumesCloneNegativeTest-1879339350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2b4a9c9a-038a-45eb-8b0f-07cc9c457fa0" returned: 0 in 0.786s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-64df83af-d62a-4165-927b-b3cdf0551164 tempest-VolumesCloneNegativeTest-1879339350 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2b4a9c9a-038a-45eb-8b0f-07cc9c457fa0 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-64df83af-d62a-4165-927b-b3cdf0551164 tempest-VolumesCloneNegativeTest-1879339350 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2b4a9c9a-038a-45eb-8b0f-07cc9c457fa0" returned: 0 in 0.188s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:58 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-64df83af-d62a-4165-927b-b3cdf0551164 tempest-VolumesCloneNegativeTest-1879339350 None] Lock "cinder-quobyte-2b4a9c9a-038a-45eb-8b0f-07cc9c457fa0" released by "delete_volume" :: held 1.201s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:44:59 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-64df83af-d62a-4165-927b-b3cdf0551164 tempest-VolumesCloneNegativeTest-1879339350 None] Created reservations ['006b4103-63d3-4f8f-9576-5fd98730bee5', '21eafb63-1fd2-456e-848d-3046858b342a', '619ba34e-be1c-4daf-b967-bcbeef5e2696', '98a19ae6-72e5-4d05-8239-b92bc77c5069'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:44:59 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=55,cinder:SELECT=49,cinder:INSERT=5,cinder:DELETE=3 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:44:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-64df83af-d62a-4165-927b-b3cdf0551164 tempest-VolumesCloneNegativeTest-1879339350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:44:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-64df83af-d62a-4165-927b-b3cdf0551164 tempest-VolumesCloneNegativeTest-1879339350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:44:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-64df83af-d62a-4165-927b-b3cdf0551164 tempest-VolumesCloneNegativeTest-1879339350 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:44:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-64df83af-d62a-4165-927b-b3cdf0551164 tempest-VolumesCloneNegativeTest-1879339350 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:44:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-64df83af-d62a-4165-927b-b3cdf0551164 tempest-VolumesCloneNegativeTest-1879339350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:44:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-64df83af-d62a-4165-927b-b3cdf0551164 tempest-VolumesCloneNegativeTest-1879339350 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:44:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-64df83af-d62a-4165-927b-b3cdf0551164 tempest-VolumesCloneNegativeTest-1879339350 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.112s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:44:59 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-64df83af-d62a-4165-927b-b3cdf0551164 tempest-VolumesCloneNegativeTest-1879339350 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:45:00 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-64df83af-d62a-4165-927b-b3cdf0551164 tempest-VolumesCloneNegativeTest-1879339350 None] Deleted volume successfully.
Sep 10 11:45:00 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-64df83af-d62a-4165-927b-b3cdf0551164 tempest-VolumesCloneNegativeTest-1879339350 None] Lock "cinder-2b4a9c9a-038a-45eb-8b0f-07cc9c457fa0-delete_volume" released by "delete_volume" :: held 2.985s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:45:01 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-acf1b269-5235-4ab5-a893-080184bebf8a tempest-GroupsV320Test-1407778223 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:45:01 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-acf1b269-5235-4ab5-a893-080184bebf8a tempest-GroupsV320Test-1407778223 None] Group tempest-GroupsV320Test-Group-1905322202: creating
Sep 10 11:45:01 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-acf1b269-5235-4ab5-a893-080184bebf8a tempest-GroupsV320Test-1407778223 None] Group tempest-GroupsV320Test-Group-1905322202: created successfully
Sep 10 11:45:01 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-acf1b269-5235-4ab5-a893-080184bebf8a tempest-GroupsV320Test-1407778223 None] Create group completed successfully.
Sep 10 11:45:03 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-082670b2-948b-4bf4-bf3f-e6f5fb4385c8 tempest-GroupsV320Test-1407778223 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:45:03 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-082670b2-948b-4bf4-bf3f-e6f5fb4385c8 tempest-GroupsV320Test-1407778223 None] Created reservations ['c632e1b0-e10c-4c25-afad-12d8b92846c4'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:45:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-082670b2-948b-4bf4-bf3f-e6f5fb4385c8 tempest-GroupsV320Test-1407778223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:45:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-082670b2-948b-4bf4-bf3f-e6f5fb4385c8 tempest-GroupsV320Test-1407778223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.024s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:45:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-082670b2-948b-4bf4-bf3f-e6f5fb4385c8 tempest-GroupsV320Test-1407778223 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:45:04 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-082670b2-948b-4bf4-bf3f-e6f5fb4385c8 tempest-GroupsV320Test-1407778223 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:45:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-082670b2-948b-4bf4-bf3f-e6f5fb4385c8 tempest-GroupsV320Test-1407778223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:45:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-082670b2-948b-4bf4-bf3f-e6f5fb4385c8 tempest-GroupsV320Test-1407778223 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-082670b2-948b-4bf4-bf3f-e6f5fb4385c8 tempest-GroupsV320Test-1407778223 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.159s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:04 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-082670b2-948b-4bf4-bf3f-e6f5fb4385c8 tempest-GroupsV320Test-1407778223 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:45:04 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-082670b2-948b-4bf4-bf3f-e6f5fb4385c8 tempest-GroupsV320Test-1407778223 None] Delete group completed successfully.
Sep 10 11:45:09 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:45:09 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:45:09 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Flow 'volume_create_manager' (5c8a6632-ea01-4354-bd33-da67ac15918d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:45:10 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64855647-acc7-4893-bcd9-72050ce1f64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:45:10 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64855647-acc7-4893-bcd9-72050ce1f64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1437222805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aec6b897-e30b-465e-9f78-55a5fd0e0430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b6ce33429824037b10361154019bf25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:45:09Z,use_quota=True,user_id='f4e63dc012554d6fa1aa4b3cbafa8d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:45:10 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f50188-ff8c-43bc-a80b-443016761fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:45:10 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f50188-ff8c-43bc-a80b-443016761fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:45:10 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fcb528e-7d26-4270-ac03-7663fffdf1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:45:10 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fcb528e-7d26-4270-ac03-7663fffdf1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aec6b897-e30b-465e-9f78-55a5fd0e0430', 'volume_name': 'volume-aec6b897-e30b-465e-9f78-55a5fd0e0430', 'volume_size': 1, 'image_id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee56e2a9864a4b70aa312dea5a262bbd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'created_at': datetime.datetime(2025, 9, 10, 9, 15, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 9, 15, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39a0ac1b-5093-4de2-911f-205906a7575b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4f519fbb50>}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:45:10 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a94ff6-20bd-41f3-905c-18be48c206d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:45:10 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a94ff6-20bd-41f3-905c-18be48c206d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:45:10 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a26650b-1b9c-48e2-a3d9-c704f503e6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:45:10 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Volume aec6b897-e30b-465e-9f78-55a5fd0e0430: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aec6b897-e30b-465e-9f78-55a5fd0e0430', 'volume_size': 1, 'image_id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee56e2a9864a4b70aa312dea5a262bbd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'created_at': datetime.datetime(2025, 9, 10, 9, 15, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 9, 15, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39a0ac1b-5093-4de2-911f-205906a7575b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4f519fbb50>}
Sep 10 11:45:10 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Cloning aec6b897-e30b-465e-9f78-55a5fd0e0430 from image 39a0ac1b-5093-4de2-911f-205906a7575b  at location (None, None). {{(pid=82594) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 11:45:11 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_9au3tyxjdevstack@QuobyteHD, size 20.69 MB, duration 1.07 sec {{(pid=82594) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 11:45:11 devstack cinder-volume[82594]: INFO cinder.image.image_utils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Image download 20.69 MB at 19.28 MB/s
Sep 10 11:45:11 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfb259b-eeaa-407c-ae0f-7b0021fa7e6a]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:45:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_9au3tyxjdevstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:12 devstack sudo[91855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_9au3tyxjdevstack@QuobyteHD
Sep 10 11:45:12 devstack sudo[91855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:45:15 devstack sudo[91855]: pam_unix(sudo:session): session closed for user root
Sep 10 11:45:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_9au3tyxjdevstack@QuobyteHD" returned: 0 in 3.717s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:15 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Temporary image 39a0ac1b-5093-4de2-911f-205906a7575b is fetched for user f4e63dc012554d6fa1aa4b3cbafa8d6b. {{(pid=82594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 11:45:15 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaeeba8e-f4a6-46cc-98ac-8b7675c829d0]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:45:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_9au3tyxjdevstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:16 devstack sudo[91860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_9au3tyxjdevstack@QuobyteHD
Sep 10 11:45:16 devstack sudo[91860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:45:18 devstack sudo[91860]: pam_unix(sudo:session): session closed for user root
Sep 10 11:45:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_9au3tyxjdevstack@QuobyteHD" returned: 0 in 3.069s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:45:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:45:19 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1437222805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aec6b897-e30b-465e-9f78-55a5fd0e0430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b6ce33429824037b10361154019bf25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:45:09Z,use_quota=True,user_id='f4e63dc012554d6fa1aa4b3cbafa8d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:45:19 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Creating volume aec6b897-e30b-465e-9f78-55a5fd0e0430 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:45:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:45:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:45:19 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:45:19 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:45:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:45:19 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:45:19 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:45:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:19 devstack quobyte-client[82616]: System call of process 91866 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:45:19 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=52, name=volume-aec6b897-e30b-465e-9f78-55a5fd0e0430, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:45:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430 1073741824" returned: 0 in 0.980s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430" returned: 0 in 0.309s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:20 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] <== create_volume: return (1487ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:45:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:45:21 devstack cinder-volume[82594]: DEBUG cinder.volume.volume_utils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Attempting download of 39a0ac1b-5093-4de2-911f-205906a7575b ((None, None)) to volume aec6b897-e30b-465e-9f78-55a5fd0e0430. {{(pid=82594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 11:45:21 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0c8574-4d76-4c4c-9e49-6d81a4fdfab0]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:45:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_39a0ac1b-5093-4de2-911f-205906a7575b_jjhrvmwe {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_39a0ac1b-5093-4de2-911f-205906a7575b_jjhrvmwe" returned: 0 in 0.506s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39a0ac1b-5093-4de2-911f-205906a7575b_jjhrvmwe {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39a0ac1b-5093-4de2-911f-205906a7575b_jjhrvmwe" returned: 1 in 0.500s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39a0ac1b-5093-4de2-911f-205906a7575b_jjhrvmwe' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 11:45:22 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9242aa-1921-4266-83b3-dadb30fd6220]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:45:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_9au3tyxjdevstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:45:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:45:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:45:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:45:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:45:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:45:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.278s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:22 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:45:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_9au3tyxjdevstack@QuobyteHD" returned: 0 in 0.998s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:23 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] 39a0ac1b-5093-4de2-911f-205906a7575b was qcow2, converting to raw {{(pid=82594) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 11:45:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_9au3tyxjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:23 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=52, name=volume-aec6b897-e30b-465e-9f78-55a5fd0e0430, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:45:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_9au3tyxjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430" returned: 0 in 1.528s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:25 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_9au3tyxjdevstack@QuobyteHD, size 112.00 MB, duration 1.58 sec, destination /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430 {{(pid=82594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 11:45:25 devstack cinder-volume[82594]: INFO cinder.image.image_utils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Converted 112.00 MB image at 70.79 MB/s
Sep 10 11:45:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:25 devstack quobyte-client[82616]: System call of process 91890 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:45:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430 1G" returned: 0 in 0.241s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:25 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce99ebb-8b3b-447e-883a-0cfd3a398dc3]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:45:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430" returned: 0 in 0.568s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430" returned: 1 in 0.573s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 11:45:26 devstack cinder-volume[82594]: DEBUG cinder.volume.volume_utils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Downloaded image 39a0ac1b-5093-4de2-911f-205906a7575b ((None, None)) to volume aec6b897-e30b-465e-9f78-55a5fd0e0430 successfully. {{(pid=82594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 11:45:26 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Temporary image 39a0ac1b-5093-4de2-911f-205906a7575b for user f4e63dc012554d6fa1aa4b3cbafa8d6b is deleted. {{(pid=82594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 11:45:26 devstack cinder-volume[82594]: DEBUG cinder.volume.volume_utils [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Marking volume aec6b897-e30b-465e-9f78-55a5fd0e0430 as bootable. {{(pid=82594) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 11:45:27 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Copying metadata from image 39a0ac1b-5093-4de2-911f-205906a7575b to aec6b897-e30b-465e-9f78-55a5fd0e0430. {{(pid=82594) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 11:45:27 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Creating volume glance metadata for volume aec6b897-e30b-465e-9f78-55a5fd0e0430 backed by image 39a0ac1b-5093-4de2-911f-205906a7575b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82594) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 11:45:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a26650b-1b9c-48e2-a3d9-c704f503e6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aec6b897-e30b-465e-9f78-55a5fd0e0430', 'volume_size': 1, 'image_id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee56e2a9864a4b70aa312dea5a262bbd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'created_at': datetime.datetime(2025, 9, 10, 9, 15, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 9, 15, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39a0ac1b-5093-4de2-911f-205906a7575b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4f519fbb50>}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:45:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c457930b-f38d-4cf3-b827-75cf42180226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:45:27 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Volume volume-aec6b897-e30b-465e-9f78-55a5fd0e0430 (aec6b897-e30b-465e-9f78-55a5fd0e0430): created successfully
Sep 10 11:45:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c457930b-f38d-4cf3-b827-75cf42180226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:45:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Flow 'volume_create_manager' (5c8a6632-ea01-4354-bd33-da67ac15918d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:45:27 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-562d7060-e64f-4148-bd9d-30254ef5133a tempest-VolumesExtendTest-104178339 None] Created volume successfully.
Sep 10 11:45:29 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-a667a3dc-08a5-4fb0-90e5-44931ef02115 tempest-VolumesExtendTest-104178339 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:45:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a667a3dc-08a5-4fb0-90e5-44931ef02115 tempest-VolumesExtendTest-104178339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:45:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a667a3dc-08a5-4fb0-90e5-44931ef02115 tempest-VolumesExtendTest-104178339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:45:29 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4c10a5-7623-4ac0-a631-f3c4a50c3b82]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:45:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a667a3dc-08a5-4fb0-90e5-44931ef02115 tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:30 devstack quobyte-client[82616]: System call of process 91917 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:45:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a667a3dc-08a5-4fb0-90e5-44931ef02115 tempest-VolumesExtendTest-104178339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430" returned: 0 in 1.181s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a667a3dc-08a5-4fb0-90e5-44931ef02115 tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a667a3dc-08a5-4fb0-90e5-44931ef02115 tempest-VolumesExtendTest-104178339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430" returned: 1 in 0.458s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a667a3dc-08a5-4fb0-90e5-44931ef02115 tempest-VolumesExtendTest-104178339 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 11:45:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a667a3dc-08a5-4fb0-90e5-44931ef02115 tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430 2G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:31 devstack quobyte-client[82616]: System call of process 91922 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:45:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a667a3dc-08a5-4fb0-90e5-44931ef02115 tempest-VolumesExtendTest-104178339 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430 2G" returned: 0 in 0.241s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a667a3dc-08a5-4fb0-90e5-44931ef02115 tempest-VolumesExtendTest-104178339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.195s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:45:31 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-a667a3dc-08a5-4fb0-90e5-44931ef02115 tempest-VolumesExtendTest-104178339 None] Extend volume completed successfully.
Sep 10 11:45:32 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-51c97441-12ee-45c9-ad2e-a2ad851bef79 tempest-VolumesExtendTest-104178339 None] Acquiring lock "cinder-aec6b897-e30b-465e-9f78-55a5fd0e0430-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:45:32 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-51c97441-12ee-45c9-ad2e-a2ad851bef79 tempest-VolumesExtendTest-104178339 None] Lock "cinder-aec6b897-e30b-465e-9f78-55a5fd0e0430-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:45:33 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-51c97441-12ee-45c9-ad2e-a2ad851bef79 tempest-VolumesExtendTest-104178339 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:45:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-51c97441-12ee-45c9-ad2e-a2ad851bef79 tempest-VolumesExtendTest-104178339 None] Acquiring lock "cinder-quobyte-aec6b897-e30b-465e-9f78-55a5fd0e0430" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:45:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-51c97441-12ee-45c9-ad2e-a2ad851bef79 tempest-VolumesExtendTest-104178339 None] Lock "cinder-quobyte-aec6b897-e30b-465e-9f78-55a5fd0e0430" acquired by "delete_volume" :: waited 0.018s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:45:33 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f15e3cd-9c35-4017-8cfd-124a0d4c6745]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:45:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-51c97441-12ee-45c9-ad2e-a2ad851bef79 tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-51c97441-12ee-45c9-ad2e-a2ad851bef79 tempest-VolumesExtendTest-104178339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430" returned: 0 in 0.650s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-51c97441-12ee-45c9-ad2e-a2ad851bef79 tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-51c97441-12ee-45c9-ad2e-a2ad851bef79 tempest-VolumesExtendTest-104178339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430" returned: 1 in 0.692s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-51c97441-12ee-45c9-ad2e-a2ad851bef79 tempest-VolumesExtendTest-104178339 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 11:45:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-51c97441-12ee-45c9-ad2e-a2ad851bef79 tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-51c97441-12ee-45c9-ad2e-a2ad851bef79 tempest-VolumesExtendTest-104178339 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-aec6b897-e30b-465e-9f78-55a5fd0e0430" returned: 0 in 0.166s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:34 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-51c97441-12ee-45c9-ad2e-a2ad851bef79 tempest-VolumesExtendTest-104178339 None] Lock "cinder-quobyte-aec6b897-e30b-465e-9f78-55a5fd0e0430" released by "delete_volume" :: held 1.825s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:45:35 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-51c97441-12ee-45c9-ad2e-a2ad851bef79 tempest-VolumesExtendTest-104178339 None] Created reservations ['3b803cb1-c4ea-4314-be25-8381fe422fb0', 'abc951d2-b4b0-4de3-80d4-32cd6945c5f6', '52fd61fe-bb14-404c-a104-f76599f79333', '2f4eb972-5050-492e-a0f6-984ee71b9fbf'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:45:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-51c97441-12ee-45c9-ad2e-a2ad851bef79 tempest-VolumesExtendTest-104178339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:45:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-51c97441-12ee-45c9-ad2e-a2ad851bef79 tempest-VolumesExtendTest-104178339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:45:35 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-51c97441-12ee-45c9-ad2e-a2ad851bef79 tempest-VolumesExtendTest-104178339 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:45:35 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-51c97441-12ee-45c9-ad2e-a2ad851bef79 tempest-VolumesExtendTest-104178339 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:45:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-51c97441-12ee-45c9-ad2e-a2ad851bef79 tempest-VolumesExtendTest-104178339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:45:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-51c97441-12ee-45c9-ad2e-a2ad851bef79 tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-51c97441-12ee-45c9-ad2e-a2ad851bef79 tempest-VolumesExtendTest-104178339 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.151s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:35 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-51c97441-12ee-45c9-ad2e-a2ad851bef79 tempest-VolumesExtendTest-104178339 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:45:35 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-51c97441-12ee-45c9-ad2e-a2ad851bef79 tempest-VolumesExtendTest-104178339 None] Deleted volume successfully.
Sep 10 11:45:36 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-51c97441-12ee-45c9-ad2e-a2ad851bef79 tempest-VolumesExtendTest-104178339 None] Lock "cinder-aec6b897-e30b-465e-9f78-55a5fd0e0430-delete_volume" released by "delete_volume" :: held 3.316s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:45:37 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:45:37 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:45:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Flow 'volume_create_manager' (bcdf8330-7928-4ab0-b7f8-d717ea93b37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:45:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea1a226-3467-4a4a-babd-0dadd56819a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:45:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea1a226-3467-4a4a-babd-0dadd56819a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-195276853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e8d81a7-2ebc-4334-867b-c8e1d82afe6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b6ce33429824037b10361154019bf25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:45:37Z,use_quota=True,user_id='f4e63dc012554d6fa1aa4b3cbafa8d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:45:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb845f3c-afb4-44b6-888d-c179328857b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:45:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb845f3c-afb4-44b6-888d-c179328857b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:45:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe6d4cd0-2737-4f07-a8a0-7566c67899da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:45:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe6d4cd0-2737-4f07-a8a0-7566c67899da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e8d81a7-2ebc-4334-867b-c8e1d82afe6a', 'volume_name': 'volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:45:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c620c858-349a-41f7-967a-2b9d3e0c50da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:45:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c620c858-349a-41f7-967a-2b9d3e0c50da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:45:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46cee6ca-06e3-4c73-bef0-ce30903a6b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:45:37 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Volume 4e8d81a7-2ebc-4334-867b-c8e1d82afe6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a', 'volume_size': 1}
Sep 10 11:45:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:45:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:45:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-195276853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e8d81a7-2ebc-4334-867b-c8e1d82afe6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b6ce33429824037b10361154019bf25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:45:37Z,use_quota=True,user_id='f4e63dc012554d6fa1aa4b3cbafa8d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:45:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Creating volume 4e8d81a7-2ebc-4334-867b-c8e1d82afe6a {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:45:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:45:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:45:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:45:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:45:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:45:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:45:37 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:45:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:37 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=53, name=volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:45:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a 1073741824" returned: 0 in 0.601s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a" returned: 0 in 0.199s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:38 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] <== create_volume: return (1166ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:45:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:45:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46cee6ca-06e3-4c73-bef0-ce30903a6b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:45:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a477036-acaa-4f9e-b1d8-c6d4d9596896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:45:39 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Volume volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a (4e8d81a7-2ebc-4334-867b-c8e1d82afe6a): created successfully
Sep 10 11:45:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a477036-acaa-4f9e-b1d8-c6d4d9596896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:45:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Flow 'volume_create_manager' (bcdf8330-7928-4ab0-b7f8-d717ea93b37e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:45:39 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-e4654c79-ba13-4672-8d26-2b03f5988b3b tempest-VolumesExtendTest-104178339 None] Created volume successfully.
Sep 10 11:45:39 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-0456b0c9-8563-44fd-b2c7-437bf661d3ae tempest-VolumesExtendTest-104178339 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:45:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0456b0c9-8563-44fd-b2c7-437bf661d3ae tempest-VolumesExtendTest-104178339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:45:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0456b0c9-8563-44fd-b2c7-437bf661d3ae tempest-VolumesExtendTest-104178339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:45:40 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-0456b0c9-8563-44fd-b2c7-437bf661d3ae tempest-VolumesExtendTest-104178339 None] Creating offline snapshot ed1ad0dd-03de-4398-adec-2abe0fff524a of volume 4e8d81a7-2ebc-4334-867b-c8e1d82afe6a {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 11:45:40 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[779a15e3-0489-4bcf-9ddf-98b832be2ccb]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:45:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0456b0c9-8563-44fd-b2c7-437bf661d3ae tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:40 devstack quobyte-client[82616]: System call of process 91970 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:45:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0456b0c9-8563-44fd-b2c7-437bf661d3ae tempest-VolumesExtendTest-104178339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a" returned: 0 in 0.583s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0456b0c9-8563-44fd-b2c7-437bf661d3ae tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a.ed1ad0dd-03de-4398-adec-2abe0fff524a 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:40 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=54, name=volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a.ed1ad0dd-03de-4398-adec-2abe0fff524a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:45:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0456b0c9-8563-44fd-b2c7-437bf661d3ae tempest-VolumesExtendTest-104178339 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a.ed1ad0dd-03de-4398-adec-2abe0fff524a 1G" returned: 0 in 0.327s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0456b0c9-8563-44fd-b2c7-437bf661d3ae tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a.ed1ad0dd-03de-4398-adec-2abe0fff524a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0456b0c9-8563-44fd-b2c7-437bf661d3ae tempest-VolumesExtendTest-104178339 None] CMD "qemu-img rebase -u -b volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a.ed1ad0dd-03de-4398-adec-2abe0fff524a" returned: 0 in 0.194s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-0456b0c9-8563-44fd-b2c7-437bf661d3ae tempest-VolumesExtendTest-104178339 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a.ed1ad0dd-03de-4398-adec-2abe0fff524a is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:45:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0456b0c9-8563-44fd-b2c7-437bf661d3ae tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a.ed1ad0dd-03de-4398-adec-2abe0fff524a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0456b0c9-8563-44fd-b2c7-437bf661d3ae tempest-VolumesExtendTest-104178339 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a.ed1ad0dd-03de-4398-adec-2abe0fff524a" returned: 0 in 0.136s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-0456b0c9-8563-44fd-b2c7-437bf661d3ae tempest-VolumesExtendTest-104178339 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 11:45:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0456b0c9-8563-44fd-b2c7-437bf661d3ae tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a.ed1ad0dd-03de-4398-adec-2abe0fff524a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0456b0c9-8563-44fd-b2c7-437bf661d3ae tempest-VolumesExtendTest-104178339 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a.ed1ad0dd-03de-4398-adec-2abe0fff524a" returned: 0 in 0.104s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0456b0c9-8563-44fd-b2c7-437bf661d3ae tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0456b0c9-8563-44fd-b2c7-437bf661d3ae tempest-VolumesExtendTest-104178339 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a.info" returned: 0 in 0.111s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-0456b0c9-8563-44fd-b2c7-437bf661d3ae tempest-VolumesExtendTest-104178339 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a.info is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:45:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0456b0c9-8563-44fd-b2c7-437bf661d3ae tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0456b0c9-8563-44fd-b2c7-437bf661d3ae tempest-VolumesExtendTest-104178339 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a.info" returned: 0 in 0.114s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0456b0c9-8563-44fd-b2c7-437bf661d3ae tempest-VolumesExtendTest-104178339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.915s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:45:42 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=57,cinder:UPDATE=62,cinder:INSERT=17,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:45:42 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-0456b0c9-8563-44fd-b2c7-437bf661d3ae tempest-VolumesExtendTest-104178339 None] Create snapshot completed successfully
Sep 10 11:45:42 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:45:42 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:45:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Flow 'volume_create_manager' (9455dce6-5b9e-4f47-bb2e-280c0d3f807f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:45:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5331a58-a0ea-42e5-bf31-c95486778b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:45:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5331a58-a0ea-42e5-bf31-c95486778b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1731739094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e4ba92-f483-4eaa-9cbf-7d28d8e1757b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='742d446689e24cf5862dae65031ab967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:45:42Z,use_quota=True,user_id='ccf96cec8d434c88ab55ff77952c4982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6bb3ccd4-72bf-46d0-bd30-f70589945bf9),volume_type_id=6bb3ccd4-72bf-46d0-bd30-f70589945bf9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:45:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a289f8c-2e0e-42fe-bee4-4442ea03d001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:45:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a289f8c-2e0e-42fe-bee4-4442ea03d001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:45:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff4530f-e217-4f89-8f86-d5c6cc02638e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:45:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff4530f-e217-4f89-8f86-d5c6cc02638e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32e4ba92-f483-4eaa-9cbf-7d28d8e1757b', 'volume_name': 'volume-32e4ba92-f483-4eaa-9cbf-7d28d8e1757b', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:45:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cca7b5e-de26-4a27-9025-f8671bb9abf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:45:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cca7b5e-de26-4a27-9025-f8671bb9abf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:45:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d86a99-4659-49cd-bbf7-e2706987227f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:45:42 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Volume 32e4ba92-f483-4eaa-9cbf-7d28d8e1757b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32e4ba92-f483-4eaa-9cbf-7d28d8e1757b', 'volume_size': 1}
Sep 10 11:45:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:45:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:45:42 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1731739094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e4ba92-f483-4eaa-9cbf-7d28d8e1757b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='742d446689e24cf5862dae65031ab967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:45:42Z,use_quota=True,user_id='ccf96cec8d434c88ab55ff77952c4982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6bb3ccd4-72bf-46d0-bd30-f70589945bf9),volume_type_id=6bb3ccd4-72bf-46d0-bd30-f70589945bf9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:45:42 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Creating volume 32e4ba92-f483-4eaa-9cbf-7d28d8e1757b {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:45:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:45:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:45:42 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:45:42 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:45:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:45:42 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:45:42 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:45:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-32e4ba92-f483-4eaa-9cbf-7d28d8e1757b 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:42 devstack quobyte-client[82616]: System call of process 91983 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:45:42 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=56, name=volume-32e4ba92-f483-4eaa-9cbf-7d28d8e1757b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:45:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-32e4ba92-f483-4eaa-9cbf-7d28d8e1757b 1073741824" returned: 0 in 0.397s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-32e4ba92-f483-4eaa-9cbf-7d28d8e1757b {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-32e4ba92-f483-4eaa-9cbf-7d28d8e1757b" returned: 0 in 0.089s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:43 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] <== create_volume: return (569ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:45:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.583s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:45:43 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d86a99-4659-49cd-bbf7-e2706987227f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32e4ba92-f483-4eaa-9cbf-7d28d8e1757b', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:45:43 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2581ff8-2431-4a93-a4a9-317cd7a28332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:45:43 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Volume volume-32e4ba92-f483-4eaa-9cbf-7d28d8e1757b (32e4ba92-f483-4eaa-9cbf-7d28d8e1757b): created successfully
Sep 10 11:45:43 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2581ff8-2431-4a93-a4a9-317cd7a28332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:45:43 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Flow 'volume_create_manager' (9455dce6-5b9e-4f47-bb2e-280c0d3f807f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:45:43 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-b78c9c45-b88f-4cff-b739-2783bada7281 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Created volume successfully.
Sep 10 11:45:43 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-b157704e-fa2d-4bb6-a21f-04fc552a4f1e tempest-VolumesExtendTest-104178339 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:45:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b157704e-fa2d-4bb6-a21f-04fc552a4f1e tempest-VolumesExtendTest-104178339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:45:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b157704e-fa2d-4bb6-a21f-04fc552a4f1e tempest-VolumesExtendTest-104178339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:45:43 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae507eb9-e11f-4c20-8c28-473337d8a12f]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:45:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b157704e-fa2d-4bb6-a21f-04fc552a4f1e tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b157704e-fa2d-4bb6-a21f-04fc552a4f1e tempest-VolumesExtendTest-104178339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a" returned: 0 in 0.417s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b157704e-fa2d-4bb6-a21f-04fc552a4f1e tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a.ed1ad0dd-03de-4398-adec-2abe0fff524a 2G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b157704e-fa2d-4bb6-a21f-04fc552a4f1e tempest-VolumesExtendTest-104178339 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a.ed1ad0dd-03de-4398-adec-2abe0fff524a 2G" returned: 0 in 0.221s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b157704e-fa2d-4bb6-a21f-04fc552a4f1e tempest-VolumesExtendTest-104178339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.726s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:45:44 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-b157704e-fa2d-4bb6-a21f-04fc552a4f1e tempest-VolumesExtendTest-104178339 None] Extend volume completed successfully.
Sep 10 11:45:44 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-0e4a6abd-5d0b-41ad-a9b5-e6dab66776fd tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:45:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0e4a6abd-5d0b-41ad-a9b5-e6dab66776fd tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:45:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0e4a6abd-5d0b-41ad-a9b5-e6dab66776fd tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:45:45 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0e4a6abd-5d0b-41ad-a9b5-e6dab66776fd tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:45:45 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0e4a6abd-5d0b-41ad-a9b5-e6dab66776fd tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:45:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0e4a6abd-5d0b-41ad-a9b5-e6dab66776fd tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:45:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0e4a6abd-5d0b-41ad-a9b5-e6dab66776fd tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0e4a6abd-5d0b-41ad-a9b5-e6dab66776fd tempest-VolumeRetypeWithoutMigrationTest-98840870 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.115s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:45 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-0e4a6abd-5d0b-41ad-a9b5-e6dab66776fd tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:45:45 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-0e4a6abd-5d0b-41ad-a9b5-e6dab66776fd tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Retype volume completed successfully.
Sep 10 11:45:46 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fa997e3c-11d2-4c34-b80c-590f699e8a5d tempest-VolumesExtendTest-104178339 None] Acquiring lock "cinder-ed1ad0dd-03de-4398-adec-2abe0fff524a-delete_snapshot" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:45:46 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fa997e3c-11d2-4c34-b80c-590f699e8a5d tempest-VolumesExtendTest-104178339 None] Lock "cinder-ed1ad0dd-03de-4398-adec-2abe0fff524a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.094s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:45:46 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-fa997e3c-11d2-4c34-b80c-590f699e8a5d tempest-VolumesExtendTest-104178339 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:45:46 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fa997e3c-11d2-4c34-b80c-590f699e8a5d tempest-VolumesExtendTest-104178339 None] Acquiring lock "cinder-quobyte-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:45:46 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fa997e3c-11d2-4c34-b80c-590f699e8a5d tempest-VolumesExtendTest-104178339 None] Lock "cinder-quobyte-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a" acquired by "delete_snapshot" :: waited 0.034s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:45:46 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fa997e3c-11d2-4c34-b80c-590f699e8a5d tempest-VolumesExtendTest-104178339 None] Acquiring lock "cinder-quobyte-ed1ad0dd-03de-4398-adec-2abe0fff524a" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:45:46 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fa997e3c-11d2-4c34-b80c-590f699e8a5d tempest-VolumesExtendTest-104178339 None] Lock "cinder-quobyte-ed1ad0dd-03de-4398-adec-2abe0fff524a" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:45:46 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-fa997e3c-11d2-4c34-b80c-590f699e8a5d tempest-VolumesExtendTest-104178339 None] Deleting offline snapshot ed1ad0dd-03de-4398-adec-2abe0fff524a of volume 4e8d81a7-2ebc-4334-867b-c8e1d82afe6a {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 11:45:46 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-fa997e3c-11d2-4c34-b80c-590f699e8a5d tempest-VolumesExtendTest-104178339 None] snapshot_file for this snap is: volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a.ed1ad0dd-03de-4398-adec-2abe0fff524a {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 11:45:46 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7697d30-f55a-4601-9054-78bb70e591a3]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:45:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fa997e3c-11d2-4c34-b80c-590f699e8a5d tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a.ed1ad0dd-03de-4398-adec-2abe0fff524a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:46 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6e157f4d-3c88-41f9-b33e-6c4bdab5b994 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Acquiring lock "cinder-32e4ba92-f483-4eaa-9cbf-7d28d8e1757b-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:45:46 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6e157f4d-3c88-41f9-b33e-6c4bdab5b994 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Lock "cinder-32e4ba92-f483-4eaa-9cbf-7d28d8e1757b-delete_volume" acquired by "delete_volume" :: waited 0.129s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:45:47 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-6e157f4d-3c88-41f9-b33e-6c4bdab5b994 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:45:47 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6e157f4d-3c88-41f9-b33e-6c4bdab5b994 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Acquiring lock "cinder-quobyte-32e4ba92-f483-4eaa-9cbf-7d28d8e1757b" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:45:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fa997e3c-11d2-4c34-b80c-590f699e8a5d tempest-VolumesExtendTest-104178339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a.ed1ad0dd-03de-4398-adec-2abe0fff524a" returned: 0 in 0.822s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:47 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-fa997e3c-11d2-4c34-b80c-590f699e8a5d tempest-VolumesExtendTest-104178339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:45:47 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6e157f4d-3c88-41f9-b33e-6c4bdab5b994 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Lock "cinder-quobyte-32e4ba92-f483-4eaa-9cbf-7d28d8e1757b" acquired by "delete_volume" :: waited 0.040s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:45:47 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb63802e-6214-48a9-9962-79750f18ba08]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:45:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fa997e3c-11d2-4c34-b80c-590f699e8a5d tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:47 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9462690b-94f3-46e7-9ebb-e9d94108a791]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:45:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6e157f4d-3c88-41f9-b33e-6c4bdab5b994 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-32e4ba92-f483-4eaa-9cbf-7d28d8e1757b {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fa997e3c-11d2-4c34-b80c-590f699e8a5d tempest-VolumesExtendTest-104178339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a" returned: 0 in 0.527s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fa997e3c-11d2-4c34-b80c-590f699e8a5d tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a.ed1ad0dd-03de-4398-adec-2abe0fff524a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:47 devstack quobyte-client[82616]: System call of process 91999 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:45:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6e157f4d-3c88-41f9-b33e-6c4bdab5b994 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-32e4ba92-f483-4eaa-9cbf-7d28d8e1757b" returned: 0 in 0.678s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:48 devstack quobyte-client[82616]: System call of process 92002 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:45:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6e157f4d-3c88-41f9-b33e-6c4bdab5b994 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-32e4ba92-f483-4eaa-9cbf-7d28d8e1757b {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6e157f4d-3c88-41f9-b33e-6c4bdab5b994 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-32e4ba92-f483-4eaa-9cbf-7d28d8e1757b" returned: 0 in 0.174s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fa997e3c-11d2-4c34-b80c-590f699e8a5d tempest-VolumesExtendTest-104178339 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a.ed1ad0dd-03de-4398-adec-2abe0fff524a" returned: 0 in 0.503s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fa997e3c-11d2-4c34-b80c-590f699e8a5d tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a.ed1ad0dd-03de-4398-adec-2abe0fff524a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:48 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6e157f4d-3c88-41f9-b33e-6c4bdab5b994 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Lock "cinder-quobyte-32e4ba92-f483-4eaa-9cbf-7d28d8e1757b" released by "delete_volume" :: held 1.244s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:45:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fa997e3c-11d2-4c34-b80c-590f699e8a5d tempest-VolumesExtendTest-104178339 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a.ed1ad0dd-03de-4398-adec-2abe0fff524a" returned: 0 in 0.344s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:48 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fa997e3c-11d2-4c34-b80c-590f699e8a5d tempest-VolumesExtendTest-104178339 None] Lock "cinder-quobyte-ed1ad0dd-03de-4398-adec-2abe0fff524a" released by "_delete_snapshot" :: held 2.478s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:45:48 devstack cinder-volume[82594]: WARNING cinder.quota [None req-6e157f4d-3c88-41f9-b33e-6c4bdab5b994 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:45:48 devstack cinder-volume[82594]: WARNING cinder.quota [None req-6e157f4d-3c88-41f9-b33e-6c4bdab5b994 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:45:48 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fa997e3c-11d2-4c34-b80c-590f699e8a5d tempest-VolumesExtendTest-104178339 None] Lock "cinder-quobyte-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a" released by "delete_snapshot" :: held 2.567s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:45:48 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-6e157f4d-3c88-41f9-b33e-6c4bdab5b994 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Created reservations ['e90f19da-9200-4c5f-a98d-214eaf3d608f', 'd98a927c-7c7e-471b-992f-abf3348bb737', 'b93ee3f7-a73b-43a9-a6bf-a2f705583343', '170f926c-33ab-4ab8-a871-a7de869a2ff5'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:45:48 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-fa997e3c-11d2-4c34-b80c-590f699e8a5d tempest-VolumesExtendTest-104178339 None] Created reservations ['1a930023-3db8-413e-ae73-4dfdec715a0c', 'e1c606a2-9b10-4bc5-a846-b5ea4f8ca1ae', '9e232bd0-4713-48e3-8bc1-fdb4e37293fc', '3882ac0e-645b-4c95-9bd7-0661d9c7ff1b'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:45:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6e157f4d-3c88-41f9-b33e-6c4bdab5b994 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:45:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6e157f4d-3c88-41f9-b33e-6c4bdab5b994 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:45:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6e157f4d-3c88-41f9-b33e-6c4bdab5b994 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:45:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6e157f4d-3c88-41f9-b33e-6c4bdab5b994 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:45:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6e157f4d-3c88-41f9-b33e-6c4bdab5b994 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:45:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6e157f4d-3c88-41f9-b33e-6c4bdab5b994 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6e157f4d-3c88-41f9-b33e-6c4bdab5b994 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.373s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:49 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-6e157f4d-3c88-41f9-b33e-6c4bdab5b994 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:45:49 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-6e157f4d-3c88-41f9-b33e-6c4bdab5b994 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Deleted volume successfully.
Sep 10 11:45:49 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-30afbd96-f951-4e76-a0f6-428c3ab0eefe tempest-VolumesExtendTest-104178339 None] Acquiring lock "cinder-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:45:49 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-fa997e3c-11d2-4c34-b80c-590f699e8a5d tempest-VolumesExtendTest-104178339 None] Delete snapshot completed successfully.
Sep 10 11:45:49 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6e157f4d-3c88-41f9-b33e-6c4bdab5b994 tempest-VolumeRetypeWithoutMigrationTest-98840870 None] Lock "cinder-32e4ba92-f483-4eaa-9cbf-7d28d8e1757b-delete_volume" released by "delete_volume" :: held 2.980s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:45:49 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fa997e3c-11d2-4c34-b80c-590f699e8a5d tempest-VolumesExtendTest-104178339 None] Lock "cinder-ed1ad0dd-03de-4398-adec-2abe0fff524a-delete_snapshot" released by "delete_snapshot" :: held 3.709s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:45:49 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-30afbd96-f951-4e76-a0f6-428c3ab0eefe tempest-VolumesExtendTest-104178339 None] Lock "cinder-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:45:50 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-30afbd96-f951-4e76-a0f6-428c3ab0eefe tempest-VolumesExtendTest-104178339 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:45:50 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-30afbd96-f951-4e76-a0f6-428c3ab0eefe tempest-VolumesExtendTest-104178339 None] Acquiring lock "cinder-quobyte-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:45:50 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-30afbd96-f951-4e76-a0f6-428c3ab0eefe tempest-VolumesExtendTest-104178339 None] Lock "cinder-quobyte-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a" acquired by "delete_volume" :: waited 0.015s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:45:50 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb708c4-3ac0-407c-b0df-1bb9cde8f87c]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:45:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-30afbd96-f951-4e76-a0f6-428c3ab0eefe tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:50 devstack quobyte-client[82616]: System call of process 92012 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:45:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-30afbd96-f951-4e76-a0f6-428c3ab0eefe tempest-VolumesExtendTest-104178339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a" returned: 0 in 0.619s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-30afbd96-f951-4e76-a0f6-428c3ab0eefe tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-30afbd96-f951-4e76-a0f6-428c3ab0eefe tempest-VolumesExtendTest-104178339 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a" returned: 0 in 0.142s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:51 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-30afbd96-f951-4e76-a0f6-428c3ab0eefe tempest-VolumesExtendTest-104178339 None] Lock "cinder-quobyte-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a" released by "delete_volume" :: held 1.010s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:45:51 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-30afbd96-f951-4e76-a0f6-428c3ab0eefe tempest-VolumesExtendTest-104178339 None] Created reservations ['54d6677d-18da-450a-9060-6dcf63b52132', '8aa39fec-0786-4622-b695-c9ba49795ecb', '8895f352-78d9-4a81-a662-3382bf2c49d6', '100328d2-4eb0-4158-a9e4-5e901ba44bd4'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:45:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-30afbd96-f951-4e76-a0f6-428c3ab0eefe tempest-VolumesExtendTest-104178339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:45:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-30afbd96-f951-4e76-a0f6-428c3ab0eefe tempest-VolumesExtendTest-104178339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:45:52 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-30afbd96-f951-4e76-a0f6-428c3ab0eefe tempest-VolumesExtendTest-104178339 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:45:52 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-30afbd96-f951-4e76-a0f6-428c3ab0eefe tempest-VolumesExtendTest-104178339 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:45:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-30afbd96-f951-4e76-a0f6-428c3ab0eefe tempest-VolumesExtendTest-104178339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:45:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-30afbd96-f951-4e76-a0f6-428c3ab0eefe tempest-VolumesExtendTest-104178339 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-30afbd96-f951-4e76-a0f6-428c3ab0eefe tempest-VolumesExtendTest-104178339 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.130s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:52 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-30afbd96-f951-4e76-a0f6-428c3ab0eefe tempest-VolumesExtendTest-104178339 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:45:52 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-30afbd96-f951-4e76-a0f6-428c3ab0eefe tempest-VolumesExtendTest-104178339 None] Deleted volume successfully.
Sep 10 11:45:52 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-30afbd96-f951-4e76-a0f6-428c3ab0eefe tempest-VolumesExtendTest-104178339 None] Lock "cinder-4e8d81a7-2ebc-4334-867b-c8e1d82afe6a-delete_volume" released by "delete_volume" :: held 2.968s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:45:58 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:45:58 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:45:58 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Flow 'volume_create_manager' (4c8f8516-e96a-46f1-844e-e8853c68814e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:45:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a57fe5-3a6a-454d-b081-0a9e84e6a4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:45:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a57fe5-3a6a-454d-b081-0a9e84e6a4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2044160587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=070f98e3-da18-47b5-b9c2-bf58b02b13ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce9f2f2634fd460f922dcd5aa1935cd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:45:59Z,use_quota=True,user_id='9cd012133e29423d9f716152267cc408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:45:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a563b8d4-4f9c-494a-8468-0da582d228d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:45:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a563b8d4-4f9c-494a-8468-0da582d228d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:45:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8393670c-bbff-4833-8f66-101997b5a032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:45:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8393670c-bbff-4833-8f66-101997b5a032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '070f98e3-da18-47b5-b9c2-bf58b02b13ee', 'volume_name': 'volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:45:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f03fcca-e4f0-48b2-a660-b030497a230f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:45:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f03fcca-e4f0-48b2-a660-b030497a230f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:45:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f3c15b-cfbd-45a6-999b-b9fb932263be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:45:59 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Volume 070f98e3-da18-47b5-b9c2-bf58b02b13ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee', 'volume_size': 1}
Sep 10 11:45:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:45:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:45:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2044160587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=070f98e3-da18-47b5-b9c2-bf58b02b13ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce9f2f2634fd460f922dcd5aa1935cd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:45:59Z,use_quota=True,user_id='9cd012133e29423d9f716152267cc408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:45:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Creating volume 070f98e3-da18-47b5-b9c2-bf58b02b13ee {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:45:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:45:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:45:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:45:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:45:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:45:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:45:59 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:45:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:59 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=57, name=volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:45:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee 1073741824" returned: 0 in 0.510s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:45:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee" returned: 0 in 0.174s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:45:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] <== create_volume: return (807ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:45:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:46:00 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:DELETE=8,cinder:UPDATE=42,cinder:SELECT=43,cinder:INSERT=19 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:46:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f3c15b-cfbd-45a6-999b-b9fb932263be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:46:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9921f65-ec8a-4ba8-9603-098a1f20aec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:46:00 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Volume volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee (070f98e3-da18-47b5-b9c2-bf58b02b13ee): created successfully
Sep 10 11:46:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9921f65-ec8a-4ba8-9603-098a1f20aec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:46:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Flow 'volume_create_manager' (4c8f8516-e96a-46f1-844e-e8853c68814e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:46:00 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-85982f45-595f-46c4-91f3-1ae7c0e254b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Created volume successfully.
Sep 10 11:46:01 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-cadd38cf-99ea-4895-881e-b4381100993f tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:46:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cadd38cf-99ea-4895-881e-b4381100993f tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:46:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cadd38cf-99ea-4895-881e-b4381100993f tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:46:01 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-cadd38cf-99ea-4895-881e-b4381100993f tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Creating offline snapshot 62e4a026-1ce8-479a-9889-947e60d1e6b2 of volume 070f98e3-da18-47b5-b9c2-bf58b02b13ee {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 11:46:01 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c59d93-e2d8-4df4-bc34-1865199186e0]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:46:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cadd38cf-99ea-4895-881e-b4381100993f tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:46:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cadd38cf-99ea-4895-881e-b4381100993f tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee" returned: 0 in 0.661s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:46:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cadd38cf-99ea-4895-881e-b4381100993f tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee.62e4a026-1ce8-479a-9889-947e60d1e6b2 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:46:02 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=58, name=volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee.62e4a026-1ce8-479a-9889-947e60d1e6b2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:46:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cadd38cf-99ea-4895-881e-b4381100993f tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee.62e4a026-1ce8-479a-9889-947e60d1e6b2 1G" returned: 0 in 0.488s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:46:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cadd38cf-99ea-4895-881e-b4381100993f tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Running cmd (subprocess): qemu-img rebase -u -b volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee.62e4a026-1ce8-479a-9889-947e60d1e6b2 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:46:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cadd38cf-99ea-4895-881e-b4381100993f tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] CMD "qemu-img rebase -u -b volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee.62e4a026-1ce8-479a-9889-947e60d1e6b2" returned: 0 in 0.230s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:46:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-cadd38cf-99ea-4895-881e-b4381100993f tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee.62e4a026-1ce8-479a-9889-947e60d1e6b2 is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:46:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cadd38cf-99ea-4895-881e-b4381100993f tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee.62e4a026-1ce8-479a-9889-947e60d1e6b2 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:46:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cadd38cf-99ea-4895-881e-b4381100993f tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee.62e4a026-1ce8-479a-9889-947e60d1e6b2" returned: 0 in 0.168s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:46:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-cadd38cf-99ea-4895-881e-b4381100993f tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 11:46:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cadd38cf-99ea-4895-881e-b4381100993f tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee.62e4a026-1ce8-479a-9889-947e60d1e6b2 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:46:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cadd38cf-99ea-4895-881e-b4381100993f tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee.62e4a026-1ce8-479a-9889-947e60d1e6b2" returned: 0 in 0.141s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:46:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cadd38cf-99ea-4895-881e-b4381100993f tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:46:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cadd38cf-99ea-4895-881e-b4381100993f tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee.info" returned: 0 in 0.119s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:46:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-cadd38cf-99ea-4895-881e-b4381100993f tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee.info is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:46:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cadd38cf-99ea-4895-881e-b4381100993f tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:46:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cadd38cf-99ea-4895-881e-b4381100993f tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee.info" returned: 0 in 0.098s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:46:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cadd38cf-99ea-4895-881e-b4381100993f tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.384s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:46:04 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-cadd38cf-99ea-4895-881e-b4381100993f tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Create snapshot completed successfully
Sep 10 11:46:05 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f8ed913f-e11b-4a6b-b030-7028ad971233 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Acquiring lock "cinder-62e4a026-1ce8-479a-9889-947e60d1e6b2-delete_snapshot" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:46:06 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f8ed913f-e11b-4a6b-b030-7028ad971233 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Lock "cinder-62e4a026-1ce8-479a-9889-947e60d1e6b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.119s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:46:06 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-f8ed913f-e11b-4a6b-b030-7028ad971233 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:46:06 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f8ed913f-e11b-4a6b-b030-7028ad971233 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Acquiring lock "cinder-quobyte-070f98e3-da18-47b5-b9c2-bf58b02b13ee" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:46:06 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f8ed913f-e11b-4a6b-b030-7028ad971233 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Lock "cinder-quobyte-070f98e3-da18-47b5-b9c2-bf58b02b13ee" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:46:06 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f8ed913f-e11b-4a6b-b030-7028ad971233 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Acquiring lock "cinder-quobyte-62e4a026-1ce8-479a-9889-947e60d1e6b2" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:46:06 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f8ed913f-e11b-4a6b-b030-7028ad971233 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Lock "cinder-quobyte-62e4a026-1ce8-479a-9889-947e60d1e6b2" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:46:06 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-f8ed913f-e11b-4a6b-b030-7028ad971233 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Deleting offline snapshot 62e4a026-1ce8-479a-9889-947e60d1e6b2 of volume 070f98e3-da18-47b5-b9c2-bf58b02b13ee {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 11:46:06 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-f8ed913f-e11b-4a6b-b030-7028ad971233 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] snapshot_file for this snap is: volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee.62e4a026-1ce8-479a-9889-947e60d1e6b2 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 11:46:06 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69e4e31-431a-4df0-9e31-191b26328cca]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:46:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f8ed913f-e11b-4a6b-b030-7028ad971233 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee.62e4a026-1ce8-479a-9889-947e60d1e6b2 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:46:07 devstack quobyte-client[82616]: System call of process 92052 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:46:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f8ed913f-e11b-4a6b-b030-7028ad971233 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee.62e4a026-1ce8-479a-9889-947e60d1e6b2" returned: 0 in 1.149s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:46:07 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-f8ed913f-e11b-4a6b-b030-7028ad971233 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:46:07 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce4378e-a05a-4c90-82f9-6b57a2280fbc]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:46:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f8ed913f-e11b-4a6b-b030-7028ad971233 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:46:08 devstack quobyte-client[82616]: System call of process 92057 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:46:09 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:46:09 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:46:09 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Flow 'volume_create_manager' (6e73c44f-fdc9-4413-a53d-b46d5060c665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:46:09 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467de3b0-e5df-4991-beb7-f62c9961f02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:46:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f8ed913f-e11b-4a6b-b030-7028ad971233 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee" returned: 0 in 1.932s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:46:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f8ed913f-e11b-4a6b-b030-7028ad971233 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee.62e4a026-1ce8-479a-9889-947e60d1e6b2 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:46:09 devstack quobyte-client[82616]: System call of process 92065 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:46:10 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467de3b0-e5df-4991-beb7-f62c9961f02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1441607871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f912e96a-ded8-4d95-bf3c-eb085500e710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5a3433184e440a0b27737939d1b9547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:46:08Z,use_quota=True,user_id='cb7fcbc92d384a078a2b274fc83a8c3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:46:10 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (570332ab-5b84-4179-929b-971eb4df949e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:46:10 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (570332ab-5b84-4179-929b-971eb4df949e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:46:10 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9241a84b-85c9-453b-8d22-008b7bbf16d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:46:10 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9241a84b-85c9-453b-8d22-008b7bbf16d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f912e96a-ded8-4d95-bf3c-eb085500e710', 'volume_name': 'volume-f912e96a-ded8-4d95-bf3c-eb085500e710', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:46:10 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02d6a925-7eee-457d-9daf-0e1c7b8a3510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:46:10 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02d6a925-7eee-457d-9daf-0e1c7b8a3510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:46:10 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa5a95d-48c8-437d-a5af-d01f96c1c73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:46:10 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Volume f912e96a-ded8-4d95-bf3c-eb085500e710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f912e96a-ded8-4d95-bf3c-eb085500e710', 'volume_size': 1}
Sep 10 11:46:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:46:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:46:10 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1441607871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f912e96a-ded8-4d95-bf3c-eb085500e710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5a3433184e440a0b27737939d1b9547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:46:08Z,use_quota=True,user_id='cb7fcbc92d384a078a2b274fc83a8c3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:46:10 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Creating volume f912e96a-ded8-4d95-bf3c-eb085500e710 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:46:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:46:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:46:10 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:46:10 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:46:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:46:10 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:46:10 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:46:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f912e96a-ded8-4d95-bf3c-eb085500e710 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:46:11 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=60, name=volume-f912e96a-ded8-4d95-bf3c-eb085500e710, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:46:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f8ed913f-e11b-4a6b-b030-7028ad971233 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee.62e4a026-1ce8-479a-9889-947e60d1e6b2" returned: 0 in 2.360s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:46:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f8ed913f-e11b-4a6b-b030-7028ad971233 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee.62e4a026-1ce8-479a-9889-947e60d1e6b2 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:46:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f912e96a-ded8-4d95-bf3c-eb085500e710 1073741824" returned: 0 in 1.580s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:46:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f912e96a-ded8-4d95-bf3c-eb085500e710 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:46:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f8ed913f-e11b-4a6b-b030-7028ad971233 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee.62e4a026-1ce8-479a-9889-947e60d1e6b2" returned: 0 in 0.825s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:46:12 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f8ed913f-e11b-4a6b-b030-7028ad971233 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Lock "cinder-quobyte-62e4a026-1ce8-479a-9889-947e60d1e6b2" released by "_delete_snapshot" :: held 6.799s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:46:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f912e96a-ded8-4d95-bf3c-eb085500e710" returned: 0 in 0.337s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:46:12 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] <== create_volume: return (1984ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:46:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:46:13 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f8ed913f-e11b-4a6b-b030-7028ad971233 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Lock "cinder-quobyte-070f98e3-da18-47b5-b9c2-bf58b02b13ee" released by "delete_snapshot" :: held 7.057s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:46:13 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa5a95d-48c8-437d-a5af-d01f96c1c73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f912e96a-ded8-4d95-bf3c-eb085500e710', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:46:13 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec89608-36b2-4041-b7cd-0f13eeed7f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:46:13 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Volume volume-f912e96a-ded8-4d95-bf3c-eb085500e710 (f912e96a-ded8-4d95-bf3c-eb085500e710): created successfully
Sep 10 11:46:13 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec89608-36b2-4041-b7cd-0f13eeed7f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:46:13 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Flow 'volume_create_manager' (6e73c44f-fdc9-4413-a53d-b46d5060c665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:46:13 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-75734a9f-3f86-43fd-b34d-62f40b2a4160 tempest-AttachVolumeNegativeTest-1236938792 None] Created volume successfully.
Sep 10 11:46:13 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-f8ed913f-e11b-4a6b-b030-7028ad971233 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Created reservations ['a68fc6c6-0b90-4b7f-b16f-67f75951e92c', 'bc09cdf7-559d-49df-829d-b282598e5e86', 'cc05d1b1-801a-456b-8c10-1fd2aa58d859', 'ac93dc1e-bf64-4e05-9311-7245bb0af8eb'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:46:13 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-f8ed913f-e11b-4a6b-b030-7028ad971233 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Delete snapshot completed successfully.
Sep 10 11:46:13 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f8ed913f-e11b-4a6b-b030-7028ad971233 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Lock "cinder-62e4a026-1ce8-479a-9889-947e60d1e6b2-delete_snapshot" released by "delete_snapshot" :: held 7.738s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:46:14 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-625ad243-8773-4ef1-8d6d-2c05d64f045a tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Acquiring lock "cinder-070f98e3-da18-47b5-b9c2-bf58b02b13ee-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:46:14 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-625ad243-8773-4ef1-8d6d-2c05d64f045a tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Lock "cinder-070f98e3-da18-47b5-b9c2-bf58b02b13ee-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:46:14 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-625ad243-8773-4ef1-8d6d-2c05d64f045a tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:46:14 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-625ad243-8773-4ef1-8d6d-2c05d64f045a tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Acquiring lock "cinder-quobyte-070f98e3-da18-47b5-b9c2-bf58b02b13ee" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:46:14 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-625ad243-8773-4ef1-8d6d-2c05d64f045a tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Lock "cinder-quobyte-070f98e3-da18-47b5-b9c2-bf58b02b13ee" acquired by "delete_volume" :: waited 0.013s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:46:14 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[322cc81d-ca98-4513-8565-df52fa82e10e]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:46:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-625ad243-8773-4ef1-8d6d-2c05d64f045a tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:46:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-625ad243-8773-4ef1-8d6d-2c05d64f045a tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee" returned: 0 in 0.562s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:46:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-625ad243-8773-4ef1-8d6d-2c05d64f045a tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:46:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-625ad243-8773-4ef1-8d6d-2c05d64f045a tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-070f98e3-da18-47b5-b9c2-bf58b02b13ee" returned: 0 in 0.133s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:46:15 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-625ad243-8773-4ef1-8d6d-2c05d64f045a tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Lock "cinder-quobyte-070f98e3-da18-47b5-b9c2-bf58b02b13ee" released by "delete_volume" :: held 1.029s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:46:15 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-625ad243-8773-4ef1-8d6d-2c05d64f045a tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Created reservations ['22bc92b3-b453-4836-8670-e3a4d2568d22', '1625516d-a2c3-4935-bddf-20fe8caa2788', '66a68ce3-428b-4397-8f32-edf033d7a4c9', 'fc8ccda7-75df-4c58-8122-56d08d712d4c'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:46:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-625ad243-8773-4ef1-8d6d-2c05d64f045a tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:46:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-625ad243-8773-4ef1-8d6d-2c05d64f045a tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:46:15 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-625ad243-8773-4ef1-8d6d-2c05d64f045a tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:46:15 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-625ad243-8773-4ef1-8d6d-2c05d64f045a tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:46:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-625ad243-8773-4ef1-8d6d-2c05d64f045a tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:46:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-625ad243-8773-4ef1-8d6d-2c05d64f045a tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:46:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-625ad243-8773-4ef1-8d6d-2c05d64f045a tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.132s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:46:16 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-625ad243-8773-4ef1-8d6d-2c05d64f045a tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:46:16 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-625ad243-8773-4ef1-8d6d-2c05d64f045a tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Deleted volume successfully.
Sep 10 11:46:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-625ad243-8773-4ef1-8d6d-2c05d64f045a tempest-VolumeSnapshotQuotasNegativeTestJSON-1278019337 None] Lock "cinder-070f98e3-da18-47b5-b9c2-bf58b02b13ee-delete_volume" released by "delete_volume" :: held 2.203s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:46:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-7f715f19-05a8-46f3-b974-9615f88990b3 req-97f210ca-c646-4233-92bd-bf9228026f22 tempest-AttachVolumeNegativeTest-1236938792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:46:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-7f715f19-05a8-46f3-b974-9615f88990b3 req-97f210ca-c646-4233-92bd-bf9228026f22 tempest-AttachVolumeNegativeTest-1236938792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:46:19 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce22c6be-7410-4ebb-8359-9837d793b973]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:46:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-7f715f19-05a8-46f3-b974-9615f88990b3 req-97f210ca-c646-4233-92bd-bf9228026f22 tempest-AttachVolumeNegativeTest-1236938792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f912e96a-ded8-4d95-bf3c-eb085500e710 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:46:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-7f715f19-05a8-46f3-b974-9615f88990b3 req-97f210ca-c646-4233-92bd-bf9228026f22 tempest-AttachVolumeNegativeTest-1236938792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f912e96a-ded8-4d95-bf3c-eb085500e710" returned: 0 in 0.763s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:46:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-7f715f19-05a8-46f3-b974-9615f88990b3 req-97f210ca-c646-4233-92bd-bf9228026f22 tempest-AttachVolumeNegativeTest-1236938792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.849s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:46:20 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-7f715f19-05a8-46f3-b974-9615f88990b3 req-97f210ca-c646-4233-92bd-bf9228026f22 tempest-AttachVolumeNegativeTest-1236938792 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56', 'name': 'volume-f912e96a-ded8-4d95-bf3c-eb085500e710', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a23d0eb-3566-4578-adcf-69d5d8fdb45e', 'enforce_multipath': True} {{(pid=82594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 11:46:20 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-7f715f19-05a8-46f3-b974-9615f88990b3 req-97f210ca-c646-4233-92bd-bf9228026f22 tempest-AttachVolumeNegativeTest-1236938792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:46:20 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-7f715f19-05a8-46f3-b974-9615f88990b3 req-97f210ca-c646-4233-92bd-bf9228026f22 tempest-AttachVolumeNegativeTest-1236938792 None] attachment_update completed successfully.
Sep 10 11:46:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:46:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:46:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:46:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:46:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:46:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:46:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:46:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.179s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:46:22 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:46:30 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=15,cinder:SELECT=18,cinder:DELETE=1,cinder:INSERT=6 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:46:30 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=58,cinder:SELECT=42,cinder:INSERT=6,cinder:DELETE=3 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:46:51 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-8ccafe54-0565-478b-a3bb-ddba6d230010 req-352724cb-1743-4650-b808-85c091218ec8 tempest-AttachVolumeNegativeTest-1236938792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:46:51 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-8ccafe54-0565-478b-a3bb-ddba6d230010 req-352724cb-1743-4650-b808-85c091218ec8 tempest-AttachVolumeNegativeTest-1236938792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:46:51 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-8ccafe54-0565-478b-a3bb-ddba6d230010 req-352724cb-1743-4650-b808-85c091218ec8 tempest-AttachVolumeNegativeTest-1236938792 None] Terminate volume connection completed successfully.
Sep 10 11:46:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-8ccafe54-0565-478b-a3bb-ddba6d230010 req-352724cb-1743-4650-b808-85c091218ec8 tempest-AttachVolumeNegativeTest-1236938792 None] Deleting attachment 5a23d0eb-3566-4578-adcf-69d5d8fdb45e. {{(pid=82594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 11:47:01 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:47:01 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:47:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:47:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:47:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:47:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:47:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:47:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.091s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:47:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:47:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.337s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:47:22 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:47:25 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:47:26 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:47:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Flow 'volume_create_manager' (5e452b56-4072-4770-ad54-048f441dbda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:47:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b712e9-0c72-44af-9db1-420a9fc247af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:47:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b712e9-0c72-44af-9db1-420a9fc247af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-712920326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b67046c-56d0-4050-be7b-09df4ad02bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f97f959bdc478cac36ce6334cd9d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:47:25Z,use_quota=True,user_id='e1e535f49ea74e0ba514b8abe87da5e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:47:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b056662-aa6a-4538-adbb-ddf4af1bc890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:47:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b056662-aa6a-4538-adbb-ddf4af1bc890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:47:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f38c783-51e3-46d8-8721-0136ec8e5d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:47:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f38c783-51e3-46d8-8721-0136ec8e5d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b67046c-56d0-4050-be7b-09df4ad02bfb', 'volume_name': 'volume-3b67046c-56d0-4050-be7b-09df4ad02bfb', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:47:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9320887b-8fdf-4873-94d3-f0cb41b9f838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:47:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9320887b-8fdf-4873-94d3-f0cb41b9f838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:47:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d99535-a869-4be6-b385-86216191525f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:47:26 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Volume 3b67046c-56d0-4050-be7b-09df4ad02bfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b67046c-56d0-4050-be7b-09df4ad02bfb', 'volume_size': 1}
Sep 10 11:47:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:47:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:47:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-712920326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b67046c-56d0-4050-be7b-09df4ad02bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f97f959bdc478cac36ce6334cd9d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:47:25Z,use_quota=True,user_id='e1e535f49ea74e0ba514b8abe87da5e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:47:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Creating volume 3b67046c-56d0-4050-be7b-09df4ad02bfb {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:47:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:47:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:47:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:47:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:47:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:47:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:47:26 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:47:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3b67046c-56d0-4050-be7b-09df4ad02bfb 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:47:26 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=61, name=volume-3b67046c-56d0-4050-be7b-09df4ad02bfb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:47:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3b67046c-56d0-4050-be7b-09df4ad02bfb 1073741824" returned: 0 in 0.822s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:47:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3b67046c-56d0-4050-be7b-09df4ad02bfb {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:47:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3b67046c-56d0-4050-be7b-09df4ad02bfb" returned: 0 in 0.561s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:47:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] <== create_volume: return (1612ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:47:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:47:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d99535-a869-4be6-b385-86216191525f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b67046c-56d0-4050-be7b-09df4ad02bfb', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:47:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170ce418-bb1b-46c5-9770-d02044dc0773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:47:28 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Volume volume-3b67046c-56d0-4050-be7b-09df4ad02bfb (3b67046c-56d0-4050-be7b-09df4ad02bfb): created successfully
Sep 10 11:47:29 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170ce418-bb1b-46c5-9770-d02044dc0773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:47:29 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Flow 'volume_create_manager' (5e452b56-4072-4770-ad54-048f441dbda9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:47:29 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-8aedc24a-6e26-4c25-963e-9bb9b4727abb tempest-TestMinimumBasicScenario-1106895519 None] Created volume successfully.
Sep 10 11:47:39 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:47:39 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:47:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-90bde8c1-ec9d-4981-ad07-1d7705515b14 req-3c1b5009-965d-4ea0-98c5-953aa83f10b3 tempest-TestMinimumBasicScenario-1106895519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:47:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-90bde8c1-ec9d-4981-ad07-1d7705515b14 req-3c1b5009-965d-4ea0-98c5-953aa83f10b3 tempest-TestMinimumBasicScenario-1106895519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:47:46 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e9402c-e4c2-4757-bfbc-c887cdf39ba4]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:47:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-90bde8c1-ec9d-4981-ad07-1d7705515b14 req-3c1b5009-965d-4ea0-98c5-953aa83f10b3 tempest-TestMinimumBasicScenario-1106895519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3b67046c-56d0-4050-be7b-09df4ad02bfb {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:47:47 devstack quobyte-client[82616]: System call of process 92906 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:47:47 devstack quobyte-client[82616]: System call of process 92906 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:47:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-90bde8c1-ec9d-4981-ad07-1d7705515b14 req-3c1b5009-965d-4ea0-98c5-953aa83f10b3 tempest-TestMinimumBasicScenario-1106895519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3b67046c-56d0-4050-be7b-09df4ad02bfb" returned: 0 in 1.026s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:47:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-90bde8c1-ec9d-4981-ad07-1d7705515b14 req-3c1b5009-965d-4ea0-98c5-953aa83f10b3 tempest-TestMinimumBasicScenario-1106895519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.171s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:47:47 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-90bde8c1-ec9d-4981-ad07-1d7705515b14 req-3c1b5009-965d-4ea0-98c5-953aa83f10b3 tempest-TestMinimumBasicScenario-1106895519 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56', 'name': 'volume-3b67046c-56d0-4050-be7b-09df4ad02bfb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee5f5d77-1a30-4f6c-892d-de97419ef1e3', 'enforce_multipath': True} {{(pid=82594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 11:47:47 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-90bde8c1-ec9d-4981-ad07-1d7705515b14 req-3c1b5009-965d-4ea0-98c5-953aa83f10b3 tempest-TestMinimumBasicScenario-1106895519 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:47:48 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-90bde8c1-ec9d-4981-ad07-1d7705515b14 req-3c1b5009-965d-4ea0-98c5-953aa83f10b3 tempest-TestMinimumBasicScenario-1106895519 None] attachment_update completed successfully.
Sep 10 11:47:48 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:47:48 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:47:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Flow 'volume_create_manager' (417eaec0-06ed-4721-b5c0-83904e048955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:47:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eefd69c-bf6c-4873-9126-8fbc692cb1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:47:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eefd69c-bf6c-4873-9126-8fbc692cb1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1013458464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc78036e-3600-4bee-9efa-aecdad927e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0564bcd96e3745a6992137e860ba33bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:47:49Z,use_quota=True,user_id='5186581bdfcb4f0499a7acc7cd5f9a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:47:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (163a3570-448e-428f-94d2-cd7dac4f1ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:47:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (163a3570-448e-428f-94d2-cd7dac4f1ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:47:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e652566a-0e56-4a34-b514-7d6871bfdb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:47:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e652566a-0e56-4a34-b514-7d6871bfdb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc78036e-3600-4bee-9efa-aecdad927e22', 'volume_name': 'volume-dc78036e-3600-4bee-9efa-aecdad927e22', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:47:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95022573-1070-4d57-8633-cb0bb1d3e287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:47:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95022573-1070-4d57-8633-cb0bb1d3e287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:47:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876ded54-c2b1-4f21-a517-cffe1fd99b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:47:49 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Volume dc78036e-3600-4bee-9efa-aecdad927e22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc78036e-3600-4bee-9efa-aecdad927e22', 'volume_size': 1}
Sep 10 11:47:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:47:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.022s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:47:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1013458464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc78036e-3600-4bee-9efa-aecdad927e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0564bcd96e3745a6992137e860ba33bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:47:49Z,use_quota=True,user_id='5186581bdfcb4f0499a7acc7cd5f9a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:47:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Creating volume dc78036e-3600-4bee-9efa-aecdad927e22 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:47:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:47:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:47:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:47:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:47:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:47:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:47:49 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:47:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-dc78036e-3600-4bee-9efa-aecdad927e22 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:47:50 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=62, name=volume-dc78036e-3600-4bee-9efa-aecdad927e22, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:47:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-dc78036e-3600-4bee-9efa-aecdad927e22 1073741824" returned: 0 in 0.909s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:47:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-dc78036e-3600-4bee-9efa-aecdad927e22 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:47:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-dc78036e-3600-4bee-9efa-aecdad927e22" returned: 0 in 0.114s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:47:50 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] <== create_volume: return (1189ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:47:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:47:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876ded54-c2b1-4f21-a517-cffe1fd99b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc78036e-3600-4bee-9efa-aecdad927e22', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:47:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261f2cfb-5976-4478-a257-ae58d52ed1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:47:51 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Volume volume-dc78036e-3600-4bee-9efa-aecdad927e22 (dc78036e-3600-4bee-9efa-aecdad927e22): created successfully
Sep 10 11:47:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261f2cfb-5976-4478-a257-ae58d52ed1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:47:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Flow 'volume_create_manager' (417eaec0-06ed-4721-b5c0-83904e048955) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:47:51 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-63489630-072d-4667-b0f9-ab0a93a8e6e1 tempest-VolumesActionsTest-2019790529 None] Created volume successfully.
Sep 10 11:47:52 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8ce17b05-12fd-4177-8ca8-ac4ce5e9571d tempest-VolumesActionsTest-2019790529 None] Acquiring lock "cinder-dc78036e-3600-4bee-9efa-aecdad927e22" by "attach_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:47:52 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8ce17b05-12fd-4177-8ca8-ac4ce5e9571d tempest-VolumesActionsTest-2019790529 None] Lock "cinder-dc78036e-3600-4bee-9efa-aecdad927e22" acquired by "attach_volume" :: waited 0.061s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:47:52 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-8ce17b05-12fd-4177-8ca8-ac4ce5e9571d tempest-VolumesActionsTest-2019790529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:47:52 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-8ce17b05-12fd-4177-8ca8-ac4ce5e9571d tempest-VolumesActionsTest-2019790529 None] Attaching volume dc78036e-3600-4bee-9efa-aecdad927e22 to instance bb1d9ee9-93ae-41a1-93a4-f1d64f8a9a00 at mountpoint /dev/vdb on host None.
Sep 10 11:47:52 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-8ce17b05-12fd-4177-8ca8-ac4ce5e9571d tempest-VolumesActionsTest-2019790529 None] Attach volume completed successfully.
Sep 10 11:47:52 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8ce17b05-12fd-4177-8ca8-ac4ce5e9571d tempest-VolumesActionsTest-2019790529 None] Lock "cinder-dc78036e-3600-4bee-9efa-aecdad927e22" released by "attach_volume" :: held 0.795s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:47:55 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-b82b39f6-81c6-4ef5-b6b4-1b42bd46647e tempest-VolumesActionsTest-916361184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:47:55 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-b82b39f6-81c6-4ef5-b6b4-1b42bd46647e tempest-VolumesActionsTest-916361184 None] Terminate volume connection completed successfully.
Sep 10 11:47:55 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b82b39f6-81c6-4ef5-b6b4-1b42bd46647e tempest-VolumesActionsTest-916361184 None] Acquiring lock "cinder-dc78036e-3600-4bee-9efa-aecdad927e22-detach_volume" by "detach_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:47:55 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b82b39f6-81c6-4ef5-b6b4-1b42bd46647e tempest-VolumesActionsTest-916361184 None] Lock "cinder-dc78036e-3600-4bee-9efa-aecdad927e22-detach_volume" acquired by "detach_volume" :: waited 0.060s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:47:55 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-b82b39f6-81c6-4ef5-b6b4-1b42bd46647e tempest-VolumesActionsTest-916361184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:47:55 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-b82b39f6-81c6-4ef5-b6b4-1b42bd46647e tempest-VolumesActionsTest-916361184 None] Detaching volume dc78036e-3600-4bee-9efa-aecdad927e22 from instance bb1d9ee9-93ae-41a1-93a4-f1d64f8a9a00.
Sep 10 11:47:55 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-b82b39f6-81c6-4ef5-b6b4-1b42bd46647e tempest-VolumesActionsTest-916361184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:47:55 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-b82b39f6-81c6-4ef5-b6b4-1b42bd46647e tempest-VolumesActionsTest-916361184 None] Detach volume completed successfully.
Sep 10 11:47:55 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b82b39f6-81c6-4ef5-b6b4-1b42bd46647e tempest-VolumesActionsTest-916361184 None] Lock "cinder-dc78036e-3600-4bee-9efa-aecdad927e22-detach_volume" released by "detach_volume" :: held 0.209s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:47:57 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2660d29b-7177-4f7b-9285-383c1712c6b5 tempest-VolumesActionsTest-2019790529 None] Acquiring lock "cinder-dc78036e-3600-4bee-9efa-aecdad927e22-detach_volume" by "detach_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:47:58 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2660d29b-7177-4f7b-9285-383c1712c6b5 tempest-VolumesActionsTest-2019790529 None] Lock "cinder-dc78036e-3600-4bee-9efa-aecdad927e22-detach_volume" acquired by "detach_volume" :: waited 0.083s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:47:58 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-2660d29b-7177-4f7b-9285-383c1712c6b5 tempest-VolumesActionsTest-2019790529 None] Volume detach called, but volume not attached.
Sep 10 11:47:58 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2660d29b-7177-4f7b-9285-383c1712c6b5 tempest-VolumesActionsTest-2019790529 None] Lock "cinder-dc78036e-3600-4bee-9efa-aecdad927e22-detach_volume" released by "detach_volume" :: held 0.353s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:48:00 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-88dabeac-db35-4911-828e-d3b96f1e334d tempest-VolumesActionsTest-2019790529 None] Acquiring lock "cinder-dc78036e-3600-4bee-9efa-aecdad927e22-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:48:00 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-88dabeac-db35-4911-828e-d3b96f1e334d tempest-VolumesActionsTest-2019790529 None] Lock "cinder-dc78036e-3600-4bee-9efa-aecdad927e22-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:48:00 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-88dabeac-db35-4911-828e-d3b96f1e334d tempest-VolumesActionsTest-2019790529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:48:00 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-88dabeac-db35-4911-828e-d3b96f1e334d tempest-VolumesActionsTest-2019790529 None] Acquiring lock "cinder-quobyte-dc78036e-3600-4bee-9efa-aecdad927e22" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:48:00 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-88dabeac-db35-4911-828e-d3b96f1e334d tempest-VolumesActionsTest-2019790529 None] Lock "cinder-quobyte-dc78036e-3600-4bee-9efa-aecdad927e22" acquired by "delete_volume" :: waited 0.102s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:48:00 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9272ff1e-d1a3-4cfd-851d-319b01e7fbb4]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:48:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-88dabeac-db35-4911-828e-d3b96f1e334d tempest-VolumesActionsTest-2019790529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-dc78036e-3600-4bee-9efa-aecdad927e22 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:48:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-88dabeac-db35-4911-828e-d3b96f1e334d tempest-VolumesActionsTest-2019790529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-dc78036e-3600-4bee-9efa-aecdad927e22" returned: 0 in 1.300s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:48:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-88dabeac-db35-4911-828e-d3b96f1e334d tempest-VolumesActionsTest-2019790529 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-dc78036e-3600-4bee-9efa-aecdad927e22 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:48:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-88dabeac-db35-4911-828e-d3b96f1e334d tempest-VolumesActionsTest-2019790529 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-dc78036e-3600-4bee-9efa-aecdad927e22" returned: 0 in 0.287s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:48:03 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-88dabeac-db35-4911-828e-d3b96f1e334d tempest-VolumesActionsTest-2019790529 None] Lock "cinder-quobyte-dc78036e-3600-4bee-9efa-aecdad927e22" released by "delete_volume" :: held 2.375s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:48:04 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-88dabeac-db35-4911-828e-d3b96f1e334d tempest-VolumesActionsTest-2019790529 None] Created reservations ['3b8b5176-79a0-4162-b169-b49f6d0cf918', 'a6ee31c0-7d67-4fdf-84ed-aaeee0e40da2', '397d0882-1ce2-4549-bd86-d87d18b3ac80', '85be5fc8-ca6e-41c1-a76e-f5cf7183fcc6'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:48:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-88dabeac-db35-4911-828e-d3b96f1e334d tempest-VolumesActionsTest-2019790529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:48:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-88dabeac-db35-4911-828e-d3b96f1e334d tempest-VolumesActionsTest-2019790529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:48:05 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-88dabeac-db35-4911-828e-d3b96f1e334d tempest-VolumesActionsTest-2019790529 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:48:05 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-88dabeac-db35-4911-828e-d3b96f1e334d tempest-VolumesActionsTest-2019790529 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:48:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-88dabeac-db35-4911-828e-d3b96f1e334d tempest-VolumesActionsTest-2019790529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:48:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-88dabeac-db35-4911-828e-d3b96f1e334d tempest-VolumesActionsTest-2019790529 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:48:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-88dabeac-db35-4911-828e-d3b96f1e334d tempest-VolumesActionsTest-2019790529 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.322s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:48:05 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-88dabeac-db35-4911-828e-d3b96f1e334d tempest-VolumesActionsTest-2019790529 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:48:05 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-88dabeac-db35-4911-828e-d3b96f1e334d tempest-VolumesActionsTest-2019790529 None] Deleted volume successfully.
Sep 10 11:48:06 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-88dabeac-db35-4911-828e-d3b96f1e334d tempest-VolumesActionsTest-2019790529 None] Lock "cinder-dc78036e-3600-4bee-9efa-aecdad927e22-delete_volume" released by "delete_volume" :: held 6.403s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:48:14 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=20,cinder:UPDATE=17,cinder:INSERT=4 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:48:16 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=19,cinder:UPDATE=14,cinder:DELETE=2,cinder:INSERT=2 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:48:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:48:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:48:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:48:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:48:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:48:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.060s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:48:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:48:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.474s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:48:23 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:48:27 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:48:27 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:48:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Flow 'volume_create_manager' (178d4c9b-15c3-4f64-80bb-dab57dbe07ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:48:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe4a4d3-0a56-4d17-a888-4f64085fa2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe4a4d3-0a56-4d17-a888-4f64085fa2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1765943257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d2b32c-4f8e-4853-aaad-16ea4a335d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0564bcd96e3745a6992137e860ba33bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:48:27Z,use_quota=True,user_id='5186581bdfcb4f0499a7acc7cd5f9a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef48933-689e-4ea4-a14e-0ecc37d44f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef48933-689e-4ea4-a14e-0ecc37d44f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (692b249e-3e35-4406-af7c-05d45f1ae365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (692b249e-3e35-4406-af7c-05d45f1ae365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54d2b32c-4f8e-4853-aaad-16ea4a335d68', 'volume_name': 'volume-54d2b32c-4f8e-4853-aaad-16ea4a335d68', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45db1fd3-db48-423c-bd04-1229447277dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45db1fd3-db48-423c-bd04-1229447277dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5095e9d9-c3ab-412c-bf00-be1ec6e23410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:28 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Volume 54d2b32c-4f8e-4853-aaad-16ea4a335d68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54d2b32c-4f8e-4853-aaad-16ea4a335d68', 'volume_size': 1}
Sep 10 11:48:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:48:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:48:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1765943257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d2b32c-4f8e-4853-aaad-16ea4a335d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0564bcd96e3745a6992137e860ba33bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:48:27Z,use_quota=True,user_id='5186581bdfcb4f0499a7acc7cd5f9a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:48:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Creating volume 54d2b32c-4f8e-4853-aaad-16ea4a335d68 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:48:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:48:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:48:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:48:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:48:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:48:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:48:28 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:48:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-54d2b32c-4f8e-4853-aaad-16ea4a335d68 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:48:28 devstack quobyte-client[82616]: System call of process 93517 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:48:28 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=63, name=volume-54d2b32c-4f8e-4853-aaad-16ea4a335d68, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:48:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-54d2b32c-4f8e-4853-aaad-16ea4a335d68 1073741824" returned: 0 in 1.204s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:48:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-54d2b32c-4f8e-4853-aaad-16ea4a335d68 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:48:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-54d2b32c-4f8e-4853-aaad-16ea4a335d68" returned: 0 in 0.387s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:48:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] <== create_volume: return (1889ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:48:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:48:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5095e9d9-c3ab-412c-bf00-be1ec6e23410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54d2b32c-4f8e-4853-aaad-16ea4a335d68', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cedca48b-90d2-4aa7-8626-debce9536bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:30 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Volume volume-54d2b32c-4f8e-4853-aaad-16ea4a335d68 (54d2b32c-4f8e-4853-aaad-16ea4a335d68): created successfully
Sep 10 11:48:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cedca48b-90d2-4aa7-8626-debce9536bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Flow 'volume_create_manager' (178d4c9b-15c3-4f64-80bb-dab57dbe07ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:48:30 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-0646bf55-58de-4c73-a66c-7bb0ac9b67dd tempest-VolumesActionsTest-2019790529 None] Created volume successfully.
Sep 10 11:48:31 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5eadcd77-8aba-46ef-a657-c5dc9c365bdb tempest-VolumesActionsTest-916361184 None] Acquiring lock "cinder-54d2b32c-4f8e-4853-aaad-16ea4a335d68-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:48:31 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5eadcd77-8aba-46ef-a657-c5dc9c365bdb tempest-VolumesActionsTest-916361184 None] Lock "cinder-54d2b32c-4f8e-4853-aaad-16ea4a335d68-delete_volume" acquired by "delete_volume" :: waited 0.217s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:48:31 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-5eadcd77-8aba-46ef-a657-c5dc9c365bdb tempest-VolumesActionsTest-916361184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:48:31 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5eadcd77-8aba-46ef-a657-c5dc9c365bdb tempest-VolumesActionsTest-916361184 None] Acquiring lock "cinder-quobyte-54d2b32c-4f8e-4853-aaad-16ea4a335d68" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:48:31 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5eadcd77-8aba-46ef-a657-c5dc9c365bdb tempest-VolumesActionsTest-916361184 None] Lock "cinder-quobyte-54d2b32c-4f8e-4853-aaad-16ea4a335d68" acquired by "delete_volume" :: waited 0.043s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:48:32 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5d6f0d-c28d-4dcb-a2e3-10c07e74e609]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:48:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5eadcd77-8aba-46ef-a657-c5dc9c365bdb tempest-VolumesActionsTest-916361184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-54d2b32c-4f8e-4853-aaad-16ea4a335d68 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:48:33 devstack quobyte-client[82616]: System call of process 93530 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:48:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5eadcd77-8aba-46ef-a657-c5dc9c365bdb tempest-VolumesActionsTest-916361184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-54d2b32c-4f8e-4853-aaad-16ea4a335d68" returned: 0 in 1.448s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:48:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5eadcd77-8aba-46ef-a657-c5dc9c365bdb tempest-VolumesActionsTest-916361184 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-54d2b32c-4f8e-4853-aaad-16ea4a335d68 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:48:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5eadcd77-8aba-46ef-a657-c5dc9c365bdb tempest-VolumesActionsTest-916361184 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-54d2b32c-4f8e-4853-aaad-16ea4a335d68" returned: 0 in 0.181s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:48:34 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5eadcd77-8aba-46ef-a657-c5dc9c365bdb tempest-VolumesActionsTest-916361184 None] Lock "cinder-quobyte-54d2b32c-4f8e-4853-aaad-16ea4a335d68" released by "delete_volume" :: held 2.278s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:48:34 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-5eadcd77-8aba-46ef-a657-c5dc9c365bdb tempest-VolumesActionsTest-916361184 None] Created reservations ['66fead29-a4de-4d10-b6a1-db6712644873', '8cf09cd0-250b-40b8-9f6d-9e334919bdbd', '75f0335c-34cf-4fbe-8c82-6201a4078bf4', 'f943cefa-63bf-4d9b-b7af-ad3780deaff7'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:48:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5eadcd77-8aba-46ef-a657-c5dc9c365bdb tempest-VolumesActionsTest-916361184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:48:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5eadcd77-8aba-46ef-a657-c5dc9c365bdb tempest-VolumesActionsTest-916361184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:48:34 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5eadcd77-8aba-46ef-a657-c5dc9c365bdb tempest-VolumesActionsTest-916361184 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:48:34 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5eadcd77-8aba-46ef-a657-c5dc9c365bdb tempest-VolumesActionsTest-916361184 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:48:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5eadcd77-8aba-46ef-a657-c5dc9c365bdb tempest-VolumesActionsTest-916361184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:48:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5eadcd77-8aba-46ef-a657-c5dc9c365bdb tempest-VolumesActionsTest-916361184 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:48:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5eadcd77-8aba-46ef-a657-c5dc9c365bdb tempest-VolumesActionsTest-916361184 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.176s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:48:35 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-5eadcd77-8aba-46ef-a657-c5dc9c365bdb tempest-VolumesActionsTest-916361184 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:48:35 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-5eadcd77-8aba-46ef-a657-c5dc9c365bdb tempest-VolumesActionsTest-916361184 None] Deleted volume successfully.
Sep 10 11:48:36 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5eadcd77-8aba-46ef-a657-c5dc9c365bdb tempest-VolumesActionsTest-916361184 None] Lock "cinder-54d2b32c-4f8e-4853-aaad-16ea4a335d68-delete_volume" released by "delete_volume" :: held 4.464s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:48:36 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:48:36 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:48:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Flow 'volume_create_manager' (7413e934-3836-4648-afa7-337b80f02c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:48:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35ca11b9-993b-40fc-ad80-3760f1f62f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35ca11b9-993b-40fc-ad80-3760f1f62f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1055880339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d86b1a-3995-4c7a-9da7-b7d0e3344eac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0564bcd96e3745a6992137e860ba33bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:48:36Z,use_quota=True,user_id='5186581bdfcb4f0499a7acc7cd5f9a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0210ad0-1c95-4604-aabd-e93b43a5c93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0210ad0-1c95-4604-aabd-e93b43a5c93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b4bf1a-dff5-4cec-b17b-6166562ae206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b4bf1a-dff5-4cec-b17b-6166562ae206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42d86b1a-3995-4c7a-9da7-b7d0e3344eac', 'volume_name': 'volume-42d86b1a-3995-4c7a-9da7-b7d0e3344eac', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d13a09b-948f-4c24-8984-33f969effe95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d13a09b-948f-4c24-8984-33f969effe95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6ddd8f-6352-4c9a-86f3-7191224cbb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:37 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Volume 42d86b1a-3995-4c7a-9da7-b7d0e3344eac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42d86b1a-3995-4c7a-9da7-b7d0e3344eac', 'volume_size': 1}
Sep 10 11:48:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:48:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:48:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1055880339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d86b1a-3995-4c7a-9da7-b7d0e3344eac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0564bcd96e3745a6992137e860ba33bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:48:36Z,use_quota=True,user_id='5186581bdfcb4f0499a7acc7cd5f9a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:48:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Creating volume 42d86b1a-3995-4c7a-9da7-b7d0e3344eac {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:48:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:48:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:48:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:48:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:48:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:48:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:48:37 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:48:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-42d86b1a-3995-4c7a-9da7-b7d0e3344eac 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:48:37 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=64, name=volume-42d86b1a-3995-4c7a-9da7-b7d0e3344eac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:48:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-42d86b1a-3995-4c7a-9da7-b7d0e3344eac 1073741824" returned: 0 in 0.471s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:48:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-42d86b1a-3995-4c7a-9da7-b7d0e3344eac {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:48:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-42d86b1a-3995-4c7a-9da7-b7d0e3344eac" returned: 0 in 0.112s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:48:38 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] <== create_volume: return (720ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:48:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:48:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6ddd8f-6352-4c9a-86f3-7191224cbb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42d86b1a-3995-4c7a-9da7-b7d0e3344eac', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (688a2549-0ce3-4fce-98a0-238bc99786f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:38 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Volume volume-42d86b1a-3995-4c7a-9da7-b7d0e3344eac (42d86b1a-3995-4c7a-9da7-b7d0e3344eac): created successfully
Sep 10 11:48:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (688a2549-0ce3-4fce-98a0-238bc99786f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Flow 'volume_create_manager' (7413e934-3836-4648-afa7-337b80f02c2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:48:38 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-09816f6e-df34-4e7d-b8ff-3eaec8715a25 tempest-VolumesActionsTest-2019790529 None] Created volume successfully.
Sep 10 11:48:38 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e2a85ca7-a8fa-4fd2-846f-2062402eb224 tempest-VolumesActionsTest-916361184 None] Acquiring lock "cinder-42d86b1a-3995-4c7a-9da7-b7d0e3344eac-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:48:38 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e2a85ca7-a8fa-4fd2-846f-2062402eb224 tempest-VolumesActionsTest-916361184 None] Lock "cinder-42d86b1a-3995-4c7a-9da7-b7d0e3344eac-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:48:39 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-e2a85ca7-a8fa-4fd2-846f-2062402eb224 tempest-VolumesActionsTest-916361184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:48:39 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e2a85ca7-a8fa-4fd2-846f-2062402eb224 tempest-VolumesActionsTest-916361184 None] Acquiring lock "cinder-quobyte-42d86b1a-3995-4c7a-9da7-b7d0e3344eac" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:48:39 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e2a85ca7-a8fa-4fd2-846f-2062402eb224 tempest-VolumesActionsTest-916361184 None] Lock "cinder-quobyte-42d86b1a-3995-4c7a-9da7-b7d0e3344eac" acquired by "delete_volume" :: waited 0.016s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:48:39 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[38960047-a50b-428e-9884-b8274795c9ff]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:48:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e2a85ca7-a8fa-4fd2-846f-2062402eb224 tempest-VolumesActionsTest-916361184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-42d86b1a-3995-4c7a-9da7-b7d0e3344eac {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:48:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e2a85ca7-a8fa-4fd2-846f-2062402eb224 tempest-VolumesActionsTest-916361184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-42d86b1a-3995-4c7a-9da7-b7d0e3344eac" returned: 0 in 0.632s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:48:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e2a85ca7-a8fa-4fd2-846f-2062402eb224 tempest-VolumesActionsTest-916361184 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-42d86b1a-3995-4c7a-9da7-b7d0e3344eac {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:48:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e2a85ca7-a8fa-4fd2-846f-2062402eb224 tempest-VolumesActionsTest-916361184 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-42d86b1a-3995-4c7a-9da7-b7d0e3344eac" returned: 0 in 0.180s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:48:40 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e2a85ca7-a8fa-4fd2-846f-2062402eb224 tempest-VolumesActionsTest-916361184 None] Lock "cinder-quobyte-42d86b1a-3995-4c7a-9da7-b7d0e3344eac" released by "delete_volume" :: held 1.046s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:48:40 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-e2a85ca7-a8fa-4fd2-846f-2062402eb224 tempest-VolumesActionsTest-916361184 None] Created reservations ['e467f68f-7c22-49e2-90c2-184f33dbfc3e', 'cd7fc203-23b8-4203-9312-6c2af4e82758', 'b2d200b2-53ef-47f9-b50a-2e92585c9c41', 'a6d2f0ea-54e4-4b16-8eae-a8f7b187c8cf'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:48:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e2a85ca7-a8fa-4fd2-846f-2062402eb224 tempest-VolumesActionsTest-916361184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:48:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e2a85ca7-a8fa-4fd2-846f-2062402eb224 tempest-VolumesActionsTest-916361184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:48:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e2a85ca7-a8fa-4fd2-846f-2062402eb224 tempest-VolumesActionsTest-916361184 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:48:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e2a85ca7-a8fa-4fd2-846f-2062402eb224 tempest-VolumesActionsTest-916361184 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:48:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e2a85ca7-a8fa-4fd2-846f-2062402eb224 tempest-VolumesActionsTest-916361184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:48:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e2a85ca7-a8fa-4fd2-846f-2062402eb224 tempest-VolumesActionsTest-916361184 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:48:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e2a85ca7-a8fa-4fd2-846f-2062402eb224 tempest-VolumesActionsTest-916361184 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.346s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:48:41 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-e2a85ca7-a8fa-4fd2-846f-2062402eb224 tempest-VolumesActionsTest-916361184 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:48:41 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-e2a85ca7-a8fa-4fd2-846f-2062402eb224 tempest-VolumesActionsTest-916361184 None] Deleted volume successfully.
Sep 10 11:48:42 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e2a85ca7-a8fa-4fd2-846f-2062402eb224 tempest-VolumesActionsTest-916361184 None] Lock "cinder-42d86b1a-3995-4c7a-9da7-b7d0e3344eac-delete_volume" released by "delete_volume" :: held 3.264s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:48:42 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:48:42 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:48:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Flow 'volume_create_manager' (c9c58895-c2da-463b-b1c1-eaa1f5a8ce10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:48:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82813bf4-5ff1-4722-88da-ff6fe6a5a560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:43 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82813bf4-5ff1-4722-88da-ff6fe6a5a560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-499206780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5b1b7b-3286-4b0c-95e2-8da257ad540e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0564bcd96e3745a6992137e860ba33bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:48:43Z,use_quota=True,user_id='5186581bdfcb4f0499a7acc7cd5f9a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:43 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (556a7c14-ecb0-4eaa-bde2-e1ff4c9c31f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:43 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (556a7c14-ecb0-4eaa-bde2-e1ff4c9c31f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:43 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b58c3e5f-6f6a-4f8d-85d0-3121b441c55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:43 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b58c3e5f-6f6a-4f8d-85d0-3121b441c55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e5b1b7b-3286-4b0c-95e2-8da257ad540e', 'volume_name': 'volume-6e5b1b7b-3286-4b0c-95e2-8da257ad540e', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:43 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e631bbb-fc20-415e-b3ee-25ac2db9777c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:43 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e631bbb-fc20-415e-b3ee-25ac2db9777c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:43 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b099c343-d9af-42f8-813d-d8e983e4eefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:43 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Volume 6e5b1b7b-3286-4b0c-95e2-8da257ad540e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e5b1b7b-3286-4b0c-95e2-8da257ad540e', 'volume_size': 1}
Sep 10 11:48:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:48:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:48:43 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-499206780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5b1b7b-3286-4b0c-95e2-8da257ad540e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0564bcd96e3745a6992137e860ba33bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:48:43Z,use_quota=True,user_id='5186581bdfcb4f0499a7acc7cd5f9a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:48:43 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Creating volume 6e5b1b7b-3286-4b0c-95e2-8da257ad540e {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:48:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:48:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:48:43 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:48:43 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:48:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:48:43 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:48:43 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:48:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6e5b1b7b-3286-4b0c-95e2-8da257ad540e 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:48:43 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=65, name=volume-6e5b1b7b-3286-4b0c-95e2-8da257ad540e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:48:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6e5b1b7b-3286-4b0c-95e2-8da257ad540e 1073741824" returned: 0 in 0.917s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:48:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6e5b1b7b-3286-4b0c-95e2-8da257ad540e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:48:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6e5b1b7b-3286-4b0c-95e2-8da257ad540e" returned: 0 in 0.978s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:48:45 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] <== create_volume: return (2088ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:48:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.124s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:48:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b099c343-d9af-42f8-813d-d8e983e4eefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e5b1b7b-3286-4b0c-95e2-8da257ad540e', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a77c2e-e65e-4fb2-90eb-3a0031101435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:45 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Volume volume-6e5b1b7b-3286-4b0c-95e2-8da257ad540e (6e5b1b7b-3286-4b0c-95e2-8da257ad540e): created successfully
Sep 10 11:48:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a77c2e-e65e-4fb2-90eb-3a0031101435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Flow 'volume_create_manager' (c9c58895-c2da-463b-b1c1-eaa1f5a8ce10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:48:45 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-516ff320-90f9-4d1a-83d9-e59ca0bb4f61 tempest-VolumesActionsTest-2019790529 None] Created volume successfully.
Sep 10 11:48:47 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9f7bcc93-8e8a-40f8-b014-7f586a47f6fd tempest-VolumesActionsTest-916361184 None] Acquiring lock "cinder-6e5b1b7b-3286-4b0c-95e2-8da257ad540e-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:48:47 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9f7bcc93-8e8a-40f8-b014-7f586a47f6fd tempest-VolumesActionsTest-916361184 None] Lock "cinder-6e5b1b7b-3286-4b0c-95e2-8da257ad540e-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:48:47 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-9f7bcc93-8e8a-40f8-b014-7f586a47f6fd tempest-VolumesActionsTest-916361184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:48:47 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9f7bcc93-8e8a-40f8-b014-7f586a47f6fd tempest-VolumesActionsTest-916361184 None] Acquiring lock "cinder-quobyte-6e5b1b7b-3286-4b0c-95e2-8da257ad540e" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:48:47 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9f7bcc93-8e8a-40f8-b014-7f586a47f6fd tempest-VolumesActionsTest-916361184 None] Lock "cinder-quobyte-6e5b1b7b-3286-4b0c-95e2-8da257ad540e" acquired by "delete_volume" :: waited 0.016s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:48:47 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dc7db4-4694-4ab4-b245-ff60083f4505]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:48:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9f7bcc93-8e8a-40f8-b014-7f586a47f6fd tempest-VolumesActionsTest-916361184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6e5b1b7b-3286-4b0c-95e2-8da257ad540e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:48:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9f7bcc93-8e8a-40f8-b014-7f586a47f6fd tempest-VolumesActionsTest-916361184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6e5b1b7b-3286-4b0c-95e2-8da257ad540e" returned: 0 in 0.547s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:48:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9f7bcc93-8e8a-40f8-b014-7f586a47f6fd tempest-VolumesActionsTest-916361184 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6e5b1b7b-3286-4b0c-95e2-8da257ad540e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:48:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9f7bcc93-8e8a-40f8-b014-7f586a47f6fd tempest-VolumesActionsTest-916361184 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6e5b1b7b-3286-4b0c-95e2-8da257ad540e" returned: 0 in 0.219s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:48:48 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9f7bcc93-8e8a-40f8-b014-7f586a47f6fd tempest-VolumesActionsTest-916361184 None] Lock "cinder-quobyte-6e5b1b7b-3286-4b0c-95e2-8da257ad540e" released by "delete_volume" :: held 1.152s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:48:48 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-9f7bcc93-8e8a-40f8-b014-7f586a47f6fd tempest-VolumesActionsTest-916361184 None] Created reservations ['80eeb64a-81a8-4dab-8386-d95822ab21ee', '26ef62e0-38e8-4afc-a384-4115dc0b7b0e', '8f9a8a27-6ead-429f-809b-cf9bebb1315b', '080c723b-a51c-4a98-8ca2-c93691a86382'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:48:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9f7bcc93-8e8a-40f8-b014-7f586a47f6fd tempest-VolumesActionsTest-916361184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:48:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9f7bcc93-8e8a-40f8-b014-7f586a47f6fd tempest-VolumesActionsTest-916361184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:48:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9f7bcc93-8e8a-40f8-b014-7f586a47f6fd tempest-VolumesActionsTest-916361184 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:48:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9f7bcc93-8e8a-40f8-b014-7f586a47f6fd tempest-VolumesActionsTest-916361184 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:48:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9f7bcc93-8e8a-40f8-b014-7f586a47f6fd tempest-VolumesActionsTest-916361184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:48:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9f7bcc93-8e8a-40f8-b014-7f586a47f6fd tempest-VolumesActionsTest-916361184 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:48:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9f7bcc93-8e8a-40f8-b014-7f586a47f6fd tempest-VolumesActionsTest-916361184 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.142s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:48:49 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-9f7bcc93-8e8a-40f8-b014-7f586a47f6fd tempest-VolumesActionsTest-916361184 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:48:49 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-9f7bcc93-8e8a-40f8-b014-7f586a47f6fd tempest-VolumesActionsTest-916361184 None] Deleted volume successfully.
Sep 10 11:48:49 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9f7bcc93-8e8a-40f8-b014-7f586a47f6fd tempest-VolumesActionsTest-916361184 None] Lock "cinder-6e5b1b7b-3286-4b0c-95e2-8da257ad540e-delete_volume" released by "delete_volume" :: held 2.700s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:48:50 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:48:51 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:48:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Flow 'volume_create_manager' (494ffc28-c205-40ae-9a47-698ed601629e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:48:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d082e3-1a59-422f-8afd-79d7214aa8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d082e3-1a59-422f-8afd-79d7214aa8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-85811126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fbc02c7-7046-43a4-899b-d54bca76512f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0564bcd96e3745a6992137e860ba33bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:48:51Z,use_quota=True,user_id='5186581bdfcb4f0499a7acc7cd5f9a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (881f93e8-4526-4e7f-8eff-797505e80da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (881f93e8-4526-4e7f-8eff-797505e80da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe51367-043d-42c3-903e-a03d02688465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe51367-043d-42c3-903e-a03d02688465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fbc02c7-7046-43a4-899b-d54bca76512f', 'volume_name': 'volume-7fbc02c7-7046-43a4-899b-d54bca76512f', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe24da60-2e3e-4727-b476-072b45c78f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe24da60-2e3e-4727-b476-072b45c78f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b110be34-b4c0-4c02-afcb-34f6f308b0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:51 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Volume 7fbc02c7-7046-43a4-899b-d54bca76512f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fbc02c7-7046-43a4-899b-d54bca76512f', 'volume_size': 1}
Sep 10 11:48:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:48:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:48:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-85811126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fbc02c7-7046-43a4-899b-d54bca76512f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0564bcd96e3745a6992137e860ba33bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:48:51Z,use_quota=True,user_id='5186581bdfcb4f0499a7acc7cd5f9a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:48:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Creating volume 7fbc02c7-7046-43a4-899b-d54bca76512f {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:48:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:48:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:48:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:48:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:48:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:48:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:48:51 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:48:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7fbc02c7-7046-43a4-899b-d54bca76512f 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:48:51 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=66, name=volume-7fbc02c7-7046-43a4-899b-d54bca76512f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:48:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7fbc02c7-7046-43a4-899b-d54bca76512f 1073741824" returned: 0 in 0.688s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:48:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7fbc02c7-7046-43a4-899b-d54bca76512f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:48:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7fbc02c7-7046-43a4-899b-d54bca76512f" returned: 0 in 0.109s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:48:52 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] <== create_volume: return (875ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:48:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:48:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b110be34-b4c0-4c02-afcb-34f6f308b0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fbc02c7-7046-43a4-899b-d54bca76512f', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1cd5430-f2ed-4c97-b237-8460a275db44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:52 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Volume volume-7fbc02c7-7046-43a4-899b-d54bca76512f (7fbc02c7-7046-43a4-899b-d54bca76512f): created successfully
Sep 10 11:48:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1cd5430-f2ed-4c97-b237-8460a275db44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Flow 'volume_create_manager' (494ffc28-c205-40ae-9a47-698ed601629e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:48:52 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-5d618159-8bd4-422d-8c13-59e4e7a31c9c tempest-VolumesActionsTest-2019790529 None] Created volume successfully.
Sep 10 11:48:53 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e1c82921-dd0e-4bab-acd8-60f0dd0c3e68 tempest-VolumesActionsTest-916361184 None] Acquiring lock "cinder-7fbc02c7-7046-43a4-899b-d54bca76512f-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:48:53 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e1c82921-dd0e-4bab-acd8-60f0dd0c3e68 tempest-VolumesActionsTest-916361184 None] Lock "cinder-7fbc02c7-7046-43a4-899b-d54bca76512f-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:48:53 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-e1c82921-dd0e-4bab-acd8-60f0dd0c3e68 tempest-VolumesActionsTest-916361184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:48:53 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e1c82921-dd0e-4bab-acd8-60f0dd0c3e68 tempest-VolumesActionsTest-916361184 None] Acquiring lock "cinder-quobyte-7fbc02c7-7046-43a4-899b-d54bca76512f" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:48:53 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e1c82921-dd0e-4bab-acd8-60f0dd0c3e68 tempest-VolumesActionsTest-916361184 None] Lock "cinder-quobyte-7fbc02c7-7046-43a4-899b-d54bca76512f" acquired by "delete_volume" :: waited 0.015s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:48:53 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1caf3a6d-ae08-4759-8df0-2feb4977a543]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:48:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e1c82921-dd0e-4bab-acd8-60f0dd0c3e68 tempest-VolumesActionsTest-916361184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7fbc02c7-7046-43a4-899b-d54bca76512f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:48:54 devstack quobyte-client[82616]: System call of process 93647 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:48:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e1c82921-dd0e-4bab-acd8-60f0dd0c3e68 tempest-VolumesActionsTest-916361184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7fbc02c7-7046-43a4-899b-d54bca76512f" returned: 0 in 1.018s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:48:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e1c82921-dd0e-4bab-acd8-60f0dd0c3e68 tempest-VolumesActionsTest-916361184 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7fbc02c7-7046-43a4-899b-d54bca76512f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:48:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e1c82921-dd0e-4bab-acd8-60f0dd0c3e68 tempest-VolumesActionsTest-916361184 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7fbc02c7-7046-43a4-899b-d54bca76512f" returned: 0 in 0.285s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:48:55 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e1c82921-dd0e-4bab-acd8-60f0dd0c3e68 tempest-VolumesActionsTest-916361184 None] Lock "cinder-quobyte-7fbc02c7-7046-43a4-899b-d54bca76512f" released by "delete_volume" :: held 1.933s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:48:56 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-e1c82921-dd0e-4bab-acd8-60f0dd0c3e68 tempest-VolumesActionsTest-916361184 None] Created reservations ['eb600a23-6f60-4d87-887e-d2b8d1b190e4', '751942fd-845c-40cf-93c7-62079293fe03', 'c3224fcb-9272-414e-9309-787c3131bfa7', 'a5f309b3-5a5a-4697-9fc4-fe30d9a928f3'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:48:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e1c82921-dd0e-4bab-acd8-60f0dd0c3e68 tempest-VolumesActionsTest-916361184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:48:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e1c82921-dd0e-4bab-acd8-60f0dd0c3e68 tempest-VolumesActionsTest-916361184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:48:56 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e1c82921-dd0e-4bab-acd8-60f0dd0c3e68 tempest-VolumesActionsTest-916361184 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:48:56 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e1c82921-dd0e-4bab-acd8-60f0dd0c3e68 tempest-VolumesActionsTest-916361184 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:48:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e1c82921-dd0e-4bab-acd8-60f0dd0c3e68 tempest-VolumesActionsTest-916361184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:48:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e1c82921-dd0e-4bab-acd8-60f0dd0c3e68 tempest-VolumesActionsTest-916361184 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:48:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e1c82921-dd0e-4bab-acd8-60f0dd0c3e68 tempest-VolumesActionsTest-916361184 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.879s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:48:58 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-e1c82921-dd0e-4bab-acd8-60f0dd0c3e68 tempest-VolumesActionsTest-916361184 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:48:58 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-e1c82921-dd0e-4bab-acd8-60f0dd0c3e68 tempest-VolumesActionsTest-916361184 None] Deleted volume successfully.
Sep 10 11:48:58 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e1c82921-dd0e-4bab-acd8-60f0dd0c3e68 tempest-VolumesActionsTest-916361184 None] Lock "cinder-7fbc02c7-7046-43a4-899b-d54bca76512f-delete_volume" released by "delete_volume" :: held 5.135s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:48:59 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:48:59 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:48:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Flow 'volume_create_manager' (0fbd9a27-9306-4c52-bc41-7a94a96db17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:48:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f6e6345-829f-4ac7-882d-170e89674264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f6e6345-829f-4ac7-882d-170e89674264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-536391164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7adde1b-a4ea-460a-9089-03f14fcd82b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0564bcd96e3745a6992137e860ba33bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:48:59Z,use_quota=True,user_id='5186581bdfcb4f0499a7acc7cd5f9a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2102bdd-f34a-4db0-8b5f-145d1d8fd663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2102bdd-f34a-4db0-8b5f-145d1d8fd663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802549a6-1cbe-4add-8568-754d2539c4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802549a6-1cbe-4add-8568-754d2539c4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7adde1b-a4ea-460a-9089-03f14fcd82b4', 'volume_name': 'volume-a7adde1b-a4ea-460a-9089-03f14fcd82b4', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:48:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b52a70-3a4b-42a1-9129-23751e4f00c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:48:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b52a70-3a4b-42a1-9129-23751e4f00c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:49:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ae96b2-5186-4d92-8b7c-3a5475c31bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:49:00 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Volume a7adde1b-a4ea-460a-9089-03f14fcd82b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7adde1b-a4ea-460a-9089-03f14fcd82b4', 'volume_size': 1}
Sep 10 11:49:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:49:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:49:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-536391164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7adde1b-a4ea-460a-9089-03f14fcd82b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0564bcd96e3745a6992137e860ba33bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:48:59Z,use_quota=True,user_id='5186581bdfcb4f0499a7acc7cd5f9a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:49:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Creating volume a7adde1b-a4ea-460a-9089-03f14fcd82b4 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:49:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:49:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:49:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:49:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:49:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:49:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:49:00 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:49:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a7adde1b-a4ea-460a-9089-03f14fcd82b4 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:49:00 devstack quobyte-client[82616]: System call of process 93730 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:49:00 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=67, name=volume-a7adde1b-a4ea-460a-9089-03f14fcd82b4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:49:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a7adde1b-a4ea-460a-9089-03f14fcd82b4 1073741824" returned: 0 in 0.720s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:49:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a7adde1b-a4ea-460a-9089-03f14fcd82b4 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:49:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a7adde1b-a4ea-460a-9089-03f14fcd82b4" returned: 0 in 0.272s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:49:01 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] <== create_volume: return (1496ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:49:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:49:02 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ae96b2-5186-4d92-8b7c-3a5475c31bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7adde1b-a4ea-460a-9089-03f14fcd82b4', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:49:02 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f22099-b66b-48e2-a26a-b5b8b9c81111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:49:02 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Volume volume-a7adde1b-a4ea-460a-9089-03f14fcd82b4 (a7adde1b-a4ea-460a-9089-03f14fcd82b4): created successfully
Sep 10 11:49:02 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f22099-b66b-48e2-a26a-b5b8b9c81111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:49:02 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Flow 'volume_create_manager' (0fbd9a27-9306-4c52-bc41-7a94a96db17e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:49:02 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-44a73691-0b95-45ca-9a5e-46d32863f361 tempest-VolumesActionsTest-2019790529 None] Created volume successfully.
Sep 10 11:49:04 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d23432b5-dd5b-4f49-87da-24f1aec5af25 tempest-VolumesActionsTest-2019790529 None] Acquiring lock "cinder-a7adde1b-a4ea-460a-9089-03f14fcd82b4-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:49:04 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d23432b5-dd5b-4f49-87da-24f1aec5af25 tempest-VolumesActionsTest-2019790529 None] Lock "cinder-a7adde1b-a4ea-460a-9089-03f14fcd82b4-delete_volume" acquired by "delete_volume" :: waited 0.131s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:49:04 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-d23432b5-dd5b-4f49-87da-24f1aec5af25 tempest-VolumesActionsTest-2019790529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:49:04 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d23432b5-dd5b-4f49-87da-24f1aec5af25 tempest-VolumesActionsTest-2019790529 None] Acquiring lock "cinder-quobyte-a7adde1b-a4ea-460a-9089-03f14fcd82b4" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:49:04 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d23432b5-dd5b-4f49-87da-24f1aec5af25 tempest-VolumesActionsTest-2019790529 None] Lock "cinder-quobyte-a7adde1b-a4ea-460a-9089-03f14fcd82b4" acquired by "delete_volume" :: waited 0.029s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:49:04 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6080c61a-dd0b-4da2-aff8-a17e831ebbf8]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:49:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d23432b5-dd5b-4f49-87da-24f1aec5af25 tempest-VolumesActionsTest-2019790529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a7adde1b-a4ea-460a-9089-03f14fcd82b4 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:49:05 devstack quobyte-client[82616]: System call of process 93788 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:49:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d23432b5-dd5b-4f49-87da-24f1aec5af25 tempest-VolumesActionsTest-2019790529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a7adde1b-a4ea-460a-9089-03f14fcd82b4" returned: 0 in 0.683s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:49:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d23432b5-dd5b-4f49-87da-24f1aec5af25 tempest-VolumesActionsTest-2019790529 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a7adde1b-a4ea-460a-9089-03f14fcd82b4 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:49:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d23432b5-dd5b-4f49-87da-24f1aec5af25 tempest-VolumesActionsTest-2019790529 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a7adde1b-a4ea-460a-9089-03f14fcd82b4" returned: 0 in 0.241s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:49:05 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d23432b5-dd5b-4f49-87da-24f1aec5af25 tempest-VolumesActionsTest-2019790529 None] Lock "cinder-quobyte-a7adde1b-a4ea-460a-9089-03f14fcd82b4" released by "delete_volume" :: held 1.206s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:49:06 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-d23432b5-dd5b-4f49-87da-24f1aec5af25 tempest-VolumesActionsTest-2019790529 None] Created reservations ['36ef7de8-a992-4fef-86ff-878659cddefb', 'da08cd53-cff4-4acb-ad69-1671bd7b7b9e', '1405a322-c71c-4e57-a55a-c4e9010a21a0', '14624efd-2ee1-4037-9eee-ff99ee468990'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:49:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d23432b5-dd5b-4f49-87da-24f1aec5af25 tempest-VolumesActionsTest-2019790529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:49:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d23432b5-dd5b-4f49-87da-24f1aec5af25 tempest-VolumesActionsTest-2019790529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:49:06 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d23432b5-dd5b-4f49-87da-24f1aec5af25 tempest-VolumesActionsTest-2019790529 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:49:06 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d23432b5-dd5b-4f49-87da-24f1aec5af25 tempest-VolumesActionsTest-2019790529 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:49:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d23432b5-dd5b-4f49-87da-24f1aec5af25 tempest-VolumesActionsTest-2019790529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:49:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d23432b5-dd5b-4f49-87da-24f1aec5af25 tempest-VolumesActionsTest-2019790529 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:49:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d23432b5-dd5b-4f49-87da-24f1aec5af25 tempest-VolumesActionsTest-2019790529 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.218s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:49:06 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-d23432b5-dd5b-4f49-87da-24f1aec5af25 tempest-VolumesActionsTest-2019790529 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:49:07 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-d23432b5-dd5b-4f49-87da-24f1aec5af25 tempest-VolumesActionsTest-2019790529 None] Deleted volume successfully.
Sep 10 11:49:07 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d23432b5-dd5b-4f49-87da-24f1aec5af25 tempest-VolumesActionsTest-2019790529 None] Lock "cinder-a7adde1b-a4ea-460a-9089-03f14fcd82b4-delete_volume" released by "delete_volume" :: held 2.939s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:49:16 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=29,cinder:UPDATE=45,cinder:DELETE=3,cinder:INSERT=14 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:49:17 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=31,cinder:UPDATE=55,cinder:DELETE=7,cinder:INSERT=6 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:49:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:49:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:49:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:49:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:49:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:49:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.084s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:49:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:49:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.481s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:49:23 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:49:29 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:49:29 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:49:29 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Flow 'volume_create_manager' (b95adb60-0823-4a03-be13-d2c4db64e637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:49:29 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c506ef2b-dc07-45ec-a2f5-aba5411e54b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:49:29 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c506ef2b-dc07-45ec-a2f5-aba5411e54b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1113750943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e7d217-3a8c-486c-a446-e069bc44de4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5a3433184e440a0b27737939d1b9547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:49:29Z,use_quota=True,user_id='cb7fcbc92d384a078a2b274fc83a8c3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:49:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1e2dc6-da43-48fa-81bc-53113a64aa92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:49:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1e2dc6-da43-48fa-81bc-53113a64aa92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:49:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8985cfef-e578-474e-9b4f-5b38a9c6f264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:49:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8985cfef-e578-474e-9b4f-5b38a9c6f264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49e7d217-3a8c-486c-a446-e069bc44de4d', 'volume_name': 'volume-49e7d217-3a8c-486c-a446-e069bc44de4d', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:49:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5812ac1-4872-4fd3-9200-438f2ce86344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:49:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5812ac1-4872-4fd3-9200-438f2ce86344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:49:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de30553d-0dd4-464e-80dd-026157984760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:49:30 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Volume 49e7d217-3a8c-486c-a446-e069bc44de4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49e7d217-3a8c-486c-a446-e069bc44de4d', 'volume_size': 1}
Sep 10 11:49:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:49:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:49:30 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1113750943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e7d217-3a8c-486c-a446-e069bc44de4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5a3433184e440a0b27737939d1b9547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:49:29Z,use_quota=True,user_id='cb7fcbc92d384a078a2b274fc83a8c3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:49:30 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Creating volume 49e7d217-3a8c-486c-a446-e069bc44de4d {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:49:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:49:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:49:30 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:49:30 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:49:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:49:30 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:49:30 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:49:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-49e7d217-3a8c-486c-a446-e069bc44de4d 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:49:30 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=68, name=volume-49e7d217-3a8c-486c-a446-e069bc44de4d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:49:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-49e7d217-3a8c-486c-a446-e069bc44de4d 1073741824" returned: 0 in 0.937s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:49:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-49e7d217-3a8c-486c-a446-e069bc44de4d {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:49:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-49e7d217-3a8c-486c-a446-e069bc44de4d" returned: 0 in 0.237s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:49:31 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] <== create_volume: return (1420ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:49:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:49:32 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de30553d-0dd4-464e-80dd-026157984760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49e7d217-3a8c-486c-a446-e069bc44de4d', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:49:32 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324bb272-2ebc-4009-993d-00f86332081f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:49:32 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Volume volume-49e7d217-3a8c-486c-a446-e069bc44de4d (49e7d217-3a8c-486c-a446-e069bc44de4d): created successfully
Sep 10 11:49:32 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324bb272-2ebc-4009-993d-00f86332081f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:49:32 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Flow 'volume_create_manager' (b95adb60-0823-4a03-be13-d2c4db64e637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:49:32 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-d4123bd7-5f95-4c7c-a2e3-f0e0618af87a tempest-AttachVolumeNegativeTest-1236938792 None] Created volume successfully.
Sep 10 11:49:36 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:49:36 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:49:36 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Flow 'volume_create_manager' (fd83f27a-a1b2-44c3-916e-e9671b4bc80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:49:36 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b90b2d1-5088-4eae-94da-846602544227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:49:36 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b90b2d1-5088-4eae-94da-846602544227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-711548202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=569d15c4-24de-4500-8f86-90286139e344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515b54d4cfaf4c0f8ed170c73b040195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:49:36Z,use_quota=True,user_id='aa7c13db06024fc18b635d626806cc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:49:36 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6ca466-7ec1-494f-898b-e16a729ea1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:49:36 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6ca466-7ec1-494f-898b-e16a729ea1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:49:36 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240b95ee-b7db-4d80-a849-887595b4d571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:49:36 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240b95ee-b7db-4d80-a849-887595b4d571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '569d15c4-24de-4500-8f86-90286139e344', 'volume_name': 'volume-569d15c4-24de-4500-8f86-90286139e344', 'volume_size': 1, 'image_id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee56e2a9864a4b70aa312dea5a262bbd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'created_at': datetime.datetime(2025, 9, 10, 9, 15, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 9, 15, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39a0ac1b-5093-4de2-911f-205906a7575b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4f47702200>}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:49:36 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee955ccd-cd43-4d3d-8e8f-97e5cbf7bff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:49:36 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee955ccd-cd43-4d3d-8e8f-97e5cbf7bff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:49:36 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f85809e-f40f-4cf8-93a1-444ee5812215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:49:36 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Volume 569d15c4-24de-4500-8f86-90286139e344: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-569d15c4-24de-4500-8f86-90286139e344', 'volume_size': 1, 'image_id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee56e2a9864a4b70aa312dea5a262bbd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'created_at': datetime.datetime(2025, 9, 10, 9, 15, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 9, 15, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39a0ac1b-5093-4de2-911f-205906a7575b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4f47702200>}
Sep 10 11:49:36 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Cloning 569d15c4-24de-4500-8f86-90286139e344 from image 39a0ac1b-5093-4de2-911f-205906a7575b  at location (None, None). {{(pid=82594) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 11:49:37 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_6ivq6whadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82594) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 11:49:37 devstack cinder-volume[82594]: INFO cinder.image.image_utils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Image download 20.69 MB at 20.69 MB/s
Sep 10 11:49:37 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[63abf569-b468-4e2c-97c6-0b63c1a20b17]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:49:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_6ivq6whadevstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:49:38 devstack sudo[93871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_6ivq6whadevstack@QuobyteHD
Sep 10 11:49:38 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:49:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-862c3066-9a84-4f6b-aab7-35496dc70281 req-50a047ce-0e3d-4cd6-be99-538ba465b500 tempest-AttachVolumeNegativeTest-1236938792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:49:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-862c3066-9a84-4f6b-aab7-35496dc70281 req-50a047ce-0e3d-4cd6-be99-538ba465b500 tempest-AttachVolumeNegativeTest-1236938792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.013s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:49:38 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc9409e-2eaa-4937-8a9d-c938e9ac0bf1]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:49:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-862c3066-9a84-4f6b-aab7-35496dc70281 req-50a047ce-0e3d-4cd6-be99-538ba465b500 tempest-AttachVolumeNegativeTest-1236938792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-49e7d217-3a8c-486c-a446-e069bc44de4d {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:49:39 devstack quobyte-client[82616]: System call of process 93874 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:49:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-862c3066-9a84-4f6b-aab7-35496dc70281 req-50a047ce-0e3d-4cd6-be99-538ba465b500 tempest-AttachVolumeNegativeTest-1236938792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-49e7d217-3a8c-486c-a446-e069bc44de4d" returned: 0 in 0.631s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:49:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-862c3066-9a84-4f6b-aab7-35496dc70281 req-50a047ce-0e3d-4cd6-be99-538ba465b500 tempest-AttachVolumeNegativeTest-1236938792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.829s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:49:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-862c3066-9a84-4f6b-aab7-35496dc70281 req-50a047ce-0e3d-4cd6-be99-538ba465b500 tempest-AttachVolumeNegativeTest-1236938792 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56', 'name': 'volume-49e7d217-3a8c-486c-a446-e069bc44de4d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a86901b-ace7-457d-9e5e-9fc9a174840c', 'enforce_multipath': True} {{(pid=82594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 11:49:39 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-862c3066-9a84-4f6b-aab7-35496dc70281 req-50a047ce-0e3d-4cd6-be99-538ba465b500 tempest-AttachVolumeNegativeTest-1236938792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:49:40 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-862c3066-9a84-4f6b-aab7-35496dc70281 req-50a047ce-0e3d-4cd6-be99-538ba465b500 tempest-AttachVolumeNegativeTest-1236938792 None] attachment_update completed successfully.
Sep 10 11:49:41 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root
Sep 10 11:49:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_6ivq6whadevstack@QuobyteHD" returned: 0 in 3.184s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:49:41 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Temporary image 39a0ac1b-5093-4de2-911f-205906a7575b is fetched for user aa7c13db06024fc18b635d626806cc9e. {{(pid=82594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 11:49:41 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[400ef873-f95c-4bba-8d04-05f04bc76e81]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:49:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_6ivq6whadevstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:49:42 devstack sudo[93884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_6ivq6whadevstack@QuobyteHD
Sep 10 11:49:42 devstack sudo[93884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:49:44 devstack sudo[93884]: pam_unix(sudo:session): session closed for user root
Sep 10 11:49:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_6ivq6whadevstack@QuobyteHD" returned: 0 in 2.733s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:49:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:49:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:49:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-711548202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=569d15c4-24de-4500-8f86-90286139e344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515b54d4cfaf4c0f8ed170c73b040195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:49:36Z,use_quota=True,user_id='aa7c13db06024fc18b635d626806cc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:49:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Creating volume 569d15c4-24de-4500-8f86-90286139e344 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:49:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:49:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:49:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:49:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:49:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:49:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:49:44 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:49:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-569d15c4-24de-4500-8f86-90286139e344 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:49:44 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=69, name=volume-569d15c4-24de-4500-8f86-90286139e344, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:49:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-569d15c4-24de-4500-8f86-90286139e344 1073741824" returned: 0 in 0.478s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:49:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-569d15c4-24de-4500-8f86-90286139e344 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:49:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-569d15c4-24de-4500-8f86-90286139e344" returned: 0 in 0.090s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:49:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] <== create_volume: return (655ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:49:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:49:45 devstack cinder-volume[82594]: DEBUG cinder.volume.volume_utils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Attempting download of 39a0ac1b-5093-4de2-911f-205906a7575b ((None, None)) to volume 569d15c4-24de-4500-8f86-90286139e344. {{(pid=82594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 11:49:45 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc23a63-a70d-4b8e-aac8-1e176cda840f]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:49:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_39a0ac1b-5093-4de2-911f-205906a7575b_06folk_z {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:49:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_39a0ac1b-5093-4de2-911f-205906a7575b_06folk_z" returned: 0 in 0.615s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:49:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39a0ac1b-5093-4de2-911f-205906a7575b_06folk_z {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:49:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39a0ac1b-5093-4de2-911f-205906a7575b_06folk_z" returned: 1 in 0.950s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:49:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39a0ac1b-5093-4de2-911f-205906a7575b_06folk_z' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 11:49:47 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd7fcc4-6c71-4469-9137-504a04b53c9b]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:49:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_6ivq6whadevstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:49:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_6ivq6whadevstack@QuobyteHD" returned: 0 in 0.583s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:49:47 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] 39a0ac1b-5093-4de2-911f-205906a7575b was qcow2, converting to raw {{(pid=82594) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 11:49:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_6ivq6whadevstack@QuobyteHD /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-569d15c4-24de-4500-8f86-90286139e344 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:49:47 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=69, name=volume-569d15c4-24de-4500-8f86-90286139e344, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:49:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_6ivq6whadevstack@QuobyteHD /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-569d15c4-24de-4500-8f86-90286139e344" returned: 0 in 1.496s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:49:49 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_6ivq6whadevstack@QuobyteHD, size 112.00 MB, duration 1.53 sec, destination /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-569d15c4-24de-4500-8f86-90286139e344 {{(pid=82594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 11:49:49 devstack cinder-volume[82594]: INFO cinder.image.image_utils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Converted 112.00 MB image at 73.37 MB/s
Sep 10 11:49:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-569d15c4-24de-4500-8f86-90286139e344 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:49:49 devstack quobyte-client[82616]: System call of process 93954 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:49:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-569d15c4-24de-4500-8f86-90286139e344 1G" returned: 0 in 0.184s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:49:49 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[864f7681-0334-4682-b150-567ee929cd60]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:49:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-569d15c4-24de-4500-8f86-90286139e344 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:49:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-569d15c4-24de-4500-8f86-90286139e344" returned: 0 in 0.437s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:49:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-569d15c4-24de-4500-8f86-90286139e344 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:49:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-569d15c4-24de-4500-8f86-90286139e344" returned: 1 in 0.424s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:49:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-569d15c4-24de-4500-8f86-90286139e344' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 11:49:50 devstack cinder-volume[82594]: DEBUG cinder.volume.volume_utils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Downloaded image 39a0ac1b-5093-4de2-911f-205906a7575b ((None, None)) to volume 569d15c4-24de-4500-8f86-90286139e344 successfully. {{(pid=82594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 11:49:50 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Temporary image 39a0ac1b-5093-4de2-911f-205906a7575b for user aa7c13db06024fc18b635d626806cc9e is deleted. {{(pid=82594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 11:49:50 devstack cinder-volume[82594]: DEBUG cinder.volume.volume_utils [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Marking volume 569d15c4-24de-4500-8f86-90286139e344 as bootable. {{(pid=82594) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 11:49:50 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Copying metadata from image 39a0ac1b-5093-4de2-911f-205906a7575b to 569d15c4-24de-4500-8f86-90286139e344. {{(pid=82594) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 11:49:50 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Creating volume glance metadata for volume 569d15c4-24de-4500-8f86-90286139e344 backed by image 39a0ac1b-5093-4de2-911f-205906a7575b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82594) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 11:49:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f85809e-f40f-4cf8-93a1-444ee5812215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-569d15c4-24de-4500-8f86-90286139e344', 'volume_size': 1, 'image_id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee56e2a9864a4b70aa312dea5a262bbd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'created_at': datetime.datetime(2025, 9, 10, 9, 15, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 9, 15, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39a0ac1b-5093-4de2-911f-205906a7575b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4f47702200>}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:49:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (594ab4c4-84da-44a8-90f9-0e82eb2ceb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:49:51 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Volume volume-569d15c4-24de-4500-8f86-90286139e344 (569d15c4-24de-4500-8f86-90286139e344): created successfully
Sep 10 11:49:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (594ab4c4-84da-44a8-90f9-0e82eb2ceb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:49:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Flow 'volume_create_manager' (fd83f27a-a1b2-44c3-916e-e9671b4bc80c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:49:51 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-f115233a-d880-477b-9748-b4df84b9ed4d tempest-VolumesImageMetadata-59090097 None] Created volume successfully.
Sep 10 11:49:52 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-249ae24c-4a1b-4594-86c5-cd36d2b66b62 tempest-VolumesImageMetadata-59090097 None] Acquiring lock "cinder-569d15c4-24de-4500-8f86-90286139e344-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:49:52 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-249ae24c-4a1b-4594-86c5-cd36d2b66b62 tempest-VolumesImageMetadata-59090097 None] Lock "cinder-569d15c4-24de-4500-8f86-90286139e344-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:49:52 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-249ae24c-4a1b-4594-86c5-cd36d2b66b62 tempest-VolumesImageMetadata-59090097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:49:52 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-249ae24c-4a1b-4594-86c5-cd36d2b66b62 tempest-VolumesImageMetadata-59090097 None] Acquiring lock "cinder-quobyte-569d15c4-24de-4500-8f86-90286139e344" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:49:53 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-249ae24c-4a1b-4594-86c5-cd36d2b66b62 tempest-VolumesImageMetadata-59090097 None] Lock "cinder-quobyte-569d15c4-24de-4500-8f86-90286139e344" acquired by "delete_volume" :: waited 0.031s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:49:53 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[664cba4d-3600-48a9-adc1-aee8b2524686]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:49:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-249ae24c-4a1b-4594-86c5-cd36d2b66b62 tempest-VolumesImageMetadata-59090097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-569d15c4-24de-4500-8f86-90286139e344 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:49:53 devstack quobyte-client[82616]: System call of process 93963 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:49:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-249ae24c-4a1b-4594-86c5-cd36d2b66b62 tempest-VolumesImageMetadata-59090097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-569d15c4-24de-4500-8f86-90286139e344" returned: 0 in 0.529s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:49:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-249ae24c-4a1b-4594-86c5-cd36d2b66b62 tempest-VolumesImageMetadata-59090097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-569d15c4-24de-4500-8f86-90286139e344 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:49:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-249ae24c-4a1b-4594-86c5-cd36d2b66b62 tempest-VolumesImageMetadata-59090097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-569d15c4-24de-4500-8f86-90286139e344" returned: 1 in 0.472s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:49:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-249ae24c-4a1b-4594-86c5-cd36d2b66b62 tempest-VolumesImageMetadata-59090097 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-569d15c4-24de-4500-8f86-90286139e344' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 11:49:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-249ae24c-4a1b-4594-86c5-cd36d2b66b62 tempest-VolumesImageMetadata-59090097 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-569d15c4-24de-4500-8f86-90286139e344 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:49:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-249ae24c-4a1b-4594-86c5-cd36d2b66b62 tempest-VolumesImageMetadata-59090097 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-569d15c4-24de-4500-8f86-90286139e344" returned: 0 in 0.089s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:49:54 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-249ae24c-4a1b-4594-86c5-cd36d2b66b62 tempest-VolumesImageMetadata-59090097 None] Lock "cinder-quobyte-569d15c4-24de-4500-8f86-90286139e344" released by "delete_volume" :: held 1.375s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:49:54 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-249ae24c-4a1b-4594-86c5-cd36d2b66b62 tempest-VolumesImageMetadata-59090097 None] Created reservations ['3e144a23-b8e6-4749-afa3-bed545b0ec8e', '56bdea27-93cf-4a4f-b86c-e0f58d41690a', '6e2d3903-a9b7-4893-b51a-1d4d33ceb98c', 'ac70c8c7-0696-456d-81b2-e499afe0fc8a'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:49:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-249ae24c-4a1b-4594-86c5-cd36d2b66b62 tempest-VolumesImageMetadata-59090097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:49:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-249ae24c-4a1b-4594-86c5-cd36d2b66b62 tempest-VolumesImageMetadata-59090097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:49:54 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-249ae24c-4a1b-4594-86c5-cd36d2b66b62 tempest-VolumesImageMetadata-59090097 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:49:54 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-249ae24c-4a1b-4594-86c5-cd36d2b66b62 tempest-VolumesImageMetadata-59090097 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:49:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-249ae24c-4a1b-4594-86c5-cd36d2b66b62 tempest-VolumesImageMetadata-59090097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:49:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-249ae24c-4a1b-4594-86c5-cd36d2b66b62 tempest-VolumesImageMetadata-59090097 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:49:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-249ae24c-4a1b-4594-86c5-cd36d2b66b62 tempest-VolumesImageMetadata-59090097 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.107s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:49:55 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-249ae24c-4a1b-4594-86c5-cd36d2b66b62 tempest-VolumesImageMetadata-59090097 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:49:55 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-249ae24c-4a1b-4594-86c5-cd36d2b66b62 tempest-VolumesImageMetadata-59090097 None] Deleted volume successfully.
Sep 10 11:49:55 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-249ae24c-4a1b-4594-86c5-cd36d2b66b62 tempest-VolumesImageMetadata-59090097 None] Lock "cinder-569d15c4-24de-4500-8f86-90286139e344-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:50:00 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:50:00 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:50:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Flow 'volume_create_manager' (11936425-3d4b-463e-a3d4-815240584805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:50:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11145125-425c-4350-994d-fb9a5538d739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:50:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11145125-425c-4350-994d-fb9a5538d739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1097451575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a3a6e62-1aa5-46e7-a165-c6e70aadd0ee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='639bdfdd039244f99bef489e4ca75a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:50:00Z,use_quota=True,user_id='ade4b7150c6d47afaa773cfad09bc422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:50:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad0a677b-99a0-4bb2-b214-bb2b847ebd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:50:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad0a677b-99a0-4bb2-b214-bb2b847ebd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:50:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94a9da5-3961-4b1e-918e-3f319ed85a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:50:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94a9da5-3961-4b1e-918e-3f319ed85a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a3a6e62-1aa5-46e7-a165-c6e70aadd0ee', 'volume_name': 'volume-6a3a6e62-1aa5-46e7-a165-c6e70aadd0ee', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:50:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15805ecf-8325-49d3-aa10-0a76b1854a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:50:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15805ecf-8325-49d3-aa10-0a76b1854a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:50:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56464453-9701-4bae-bd75-bc4811d3a2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:50:00 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Volume 6a3a6e62-1aa5-46e7-a165-c6e70aadd0ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a3a6e62-1aa5-46e7-a165-c6e70aadd0ee', 'volume_size': 1}
Sep 10 11:50:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:50:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:50:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1097451575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a3a6e62-1aa5-46e7-a165-c6e70aadd0ee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='639bdfdd039244f99bef489e4ca75a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:50:00Z,use_quota=True,user_id='ade4b7150c6d47afaa773cfad09bc422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:50:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Creating volume 6a3a6e62-1aa5-46e7-a165-c6e70aadd0ee {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:50:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:50:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:50:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:50:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:50:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:50:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:50:00 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:50:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6a3a6e62-1aa5-46e7-a165-c6e70aadd0ee 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:00 devstack quobyte-client[82616]: System call of process 93987 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:50:00 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=70, name=volume-6a3a6e62-1aa5-46e7-a165-c6e70aadd0ee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:50:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6a3a6e62-1aa5-46e7-a165-c6e70aadd0ee 1073741824" returned: 0 in 0.497s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6a3a6e62-1aa5-46e7-a165-c6e70aadd0ee {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6a3a6e62-1aa5-46e7-a165-c6e70aadd0ee" returned: 0 in 0.104s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:01 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] <== create_volume: return (697ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:50:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:50:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56464453-9701-4bae-bd75-bc4811d3a2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a3a6e62-1aa5-46e7-a165-c6e70aadd0ee', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:50:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e61105e-37e4-4788-864e-95952a86c41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:50:01 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Volume volume-6a3a6e62-1aa5-46e7-a165-c6e70aadd0ee (6a3a6e62-1aa5-46e7-a165-c6e70aadd0ee): created successfully
Sep 10 11:50:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e61105e-37e4-4788-864e-95952a86c41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:50:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Flow 'volume_create_manager' (11936425-3d4b-463e-a3d4-815240584805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:50:01 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-69b977f5-3349-4d53-b6ae-274dbad5efd7 tempest-VolumesListTestJSON-1656463937 None] Created volume successfully.
Sep 10 11:50:03 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Flow 'volume_create_manager' (a34a6d4b-71b3-44d3-96f0-e1d1c3fa3ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa38d014-880d-4270-b629-9dc0c161a773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa38d014-880d-4270-b629-9dc0c161a773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1343656221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a2e0d58-0da4-4fd9-b35b-2ded491dad51,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='639bdfdd039244f99bef489e4ca75a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:50:03Z,use_quota=True,user_id='ade4b7150c6d47afaa773cfad09bc422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43036091-9b3c-479a-b8a9-657a07eddfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43036091-9b3c-479a-b8a9-657a07eddfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7842b1c7-dd9a-460b-a3b4-4ff40fb72634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7842b1c7-dd9a-460b-a3b4-4ff40fb72634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a2e0d58-0da4-4fd9-b35b-2ded491dad51', 'volume_name': 'volume-1a2e0d58-0da4-4fd9-b35b-2ded491dad51', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (608193bf-dca5-467c-8636-cf9173e0389c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (608193bf-dca5-467c-8636-cf9173e0389c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf81a23-d858-4a46-a8fc-b5c3e701a145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:50:03 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Volume 1a2e0d58-0da4-4fd9-b35b-2ded491dad51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a2e0d58-0da4-4fd9-b35b-2ded491dad51', 'volume_size': 1}
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1343656221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a2e0d58-0da4-4fd9-b35b-2ded491dad51,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='639bdfdd039244f99bef489e4ca75a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:50:03Z,use_quota=True,user_id='ade4b7150c6d47afaa773cfad09bc422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Creating volume 1a2e0d58-0da4-4fd9-b35b-2ded491dad51 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:50:03 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1a2e0d58-0da4-4fd9-b35b-2ded491dad51 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:03 devstack quobyte-client[82616]: System call of process 93992 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:50:03 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=71, name=volume-1a2e0d58-0da4-4fd9-b35b-2ded491dad51, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1a2e0d58-0da4-4fd9-b35b-2ded491dad51 1073741824" returned: 0 in 0.443s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1a2e0d58-0da4-4fd9-b35b-2ded491dad51 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1a2e0d58-0da4-4fd9-b35b-2ded491dad51" returned: 0 in 0.139s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] <== create_volume: return (649ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:50:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.661s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:50:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf81a23-d858-4a46-a8fc-b5c3e701a145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a2e0d58-0da4-4fd9-b35b-2ded491dad51', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:50:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fce727a-2f5f-4b73-ac70-247b8f5ab554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:50:04 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Volume volume-1a2e0d58-0da4-4fd9-b35b-2ded491dad51 (1a2e0d58-0da4-4fd9-b35b-2ded491dad51): created successfully
Sep 10 11:50:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fce727a-2f5f-4b73-ac70-247b8f5ab554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:50:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Flow 'volume_create_manager' (a34a6d4b-71b3-44d3-96f0-e1d1c3fa3ace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:50:04 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-4e05f402-ba8b-499c-9d90-8288789bafbf tempest-VolumesListTestJSON-1656463937 None] Created volume successfully.
Sep 10 11:50:05 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:50:05 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:50:05 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Flow 'volume_create_manager' (a985e9b8-fb72-476c-bd07-02da6c99d3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:50:05 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b608dd8b-63d5-4747-b2a9-4a8635498301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:50:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b608dd8b-63d5-4747-b2a9-4a8635498301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-861983007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99dde1e5-1527-458e-9fa7-96634faeb120,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='639bdfdd039244f99bef489e4ca75a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:50:06Z,use_quota=True,user_id='ade4b7150c6d47afaa773cfad09bc422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:50:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f1be0e-a557-4a1b-9bce-240100d811ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:50:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f1be0e-a557-4a1b-9bce-240100d811ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:50:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07ab351b-a041-4169-b4b3-a47f4e99f714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:50:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07ab351b-a041-4169-b4b3-a47f4e99f714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99dde1e5-1527-458e-9fa7-96634faeb120', 'volume_name': 'volume-99dde1e5-1527-458e-9fa7-96634faeb120', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:50:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfbbac5a-bd74-4a84-975d-6a22052e9e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:50:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfbbac5a-bd74-4a84-975d-6a22052e9e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:50:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (495504e1-526c-4412-8dd9-acc8b4447686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:50:06 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Volume 99dde1e5-1527-458e-9fa7-96634faeb120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99dde1e5-1527-458e-9fa7-96634faeb120', 'volume_size': 1}
Sep 10 11:50:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:50:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:50:06 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-861983007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99dde1e5-1527-458e-9fa7-96634faeb120,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='639bdfdd039244f99bef489e4ca75a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:50:06Z,use_quota=True,user_id='ade4b7150c6d47afaa773cfad09bc422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:50:06 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Creating volume 99dde1e5-1527-458e-9fa7-96634faeb120 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:50:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:50:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:50:06 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:50:06 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:50:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:50:06 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:50:06 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:50:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-99dde1e5-1527-458e-9fa7-96634faeb120 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:06 devstack quobyte-client[82616]: System call of process 94004 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:50:06 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=72, name=volume-99dde1e5-1527-458e-9fa7-96634faeb120, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:50:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-99dde1e5-1527-458e-9fa7-96634faeb120 1073741824" returned: 0 in 0.636s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-99dde1e5-1527-458e-9fa7-96634faeb120 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-99dde1e5-1527-458e-9fa7-96634faeb120" returned: 0 in 0.151s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:07 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] <== create_volume: return (931ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:50:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:50:07 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (495504e1-526c-4412-8dd9-acc8b4447686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99dde1e5-1527-458e-9fa7-96634faeb120', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:50:07 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed305068-d410-407e-af49-a2c65d9305f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:50:07 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Volume volume-99dde1e5-1527-458e-9fa7-96634faeb120 (99dde1e5-1527-458e-9fa7-96634faeb120): created successfully
Sep 10 11:50:07 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed305068-d410-407e-af49-a2c65d9305f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:50:07 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Flow 'volume_create_manager' (a985e9b8-fb72-476c-bd07-02da6c99d3d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:50:07 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-d3883f78-fcc2-43cb-aed5-d5ddc531c2e4 tempest-VolumesListTestJSON-1656463937 None] Created volume successfully.
Sep 10 11:50:08 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-d9fc735d-8338-4aae-9286-a08278c5d60e req-ac0d692b-2777-4984-8262-5c3299171dbe tempest-AttachVolumeNegativeTest-1236938792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:50:09 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-d9fc735d-8338-4aae-9286-a08278c5d60e req-ac0d692b-2777-4984-8262-5c3299171dbe tempest-AttachVolumeNegativeTest-1236938792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:50:09 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-d9fc735d-8338-4aae-9286-a08278c5d60e req-ac0d692b-2777-4984-8262-5c3299171dbe tempest-AttachVolumeNegativeTest-1236938792 None] Terminate volume connection completed successfully.
Sep 10 11:50:09 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-d9fc735d-8338-4aae-9286-a08278c5d60e req-ac0d692b-2777-4984-8262-5c3299171dbe tempest-AttachVolumeNegativeTest-1236938792 None] Deleting attachment 9a86901b-ace7-457d-9e5e-9fc9a174840c. {{(pid=82594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 11:50:13 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-cc4dbc3b-5048-4be6-b511-8e90ef382678 tempest-VolumesListTestJSON-1656463937 None] Acquiring lock "cinder-99dde1e5-1527-458e-9fa7-96634faeb120-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:50:13 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-cc4dbc3b-5048-4be6-b511-8e90ef382678 tempest-VolumesListTestJSON-1656463937 None] Lock "cinder-99dde1e5-1527-458e-9fa7-96634faeb120-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:50:13 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-cc4dbc3b-5048-4be6-b511-8e90ef382678 tempest-VolumesListTestJSON-1656463937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:50:13 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-cc4dbc3b-5048-4be6-b511-8e90ef382678 tempest-VolumesListTestJSON-1656463937 None] Acquiring lock "cinder-quobyte-99dde1e5-1527-458e-9fa7-96634faeb120" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:50:13 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-cc4dbc3b-5048-4be6-b511-8e90ef382678 tempest-VolumesListTestJSON-1656463937 None] Lock "cinder-quobyte-99dde1e5-1527-458e-9fa7-96634faeb120" acquired by "delete_volume" :: waited 0.028s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:50:13 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81c26b4-af93-4438-b74d-747a20f08093]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:50:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cc4dbc3b-5048-4be6-b511-8e90ef382678 tempest-VolumesListTestJSON-1656463937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-99dde1e5-1527-458e-9fa7-96634faeb120 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:15 devstack quobyte-client[82616]: System call of process 94026 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:50:15 devstack quobyte-client[82616]: System call of process 94026 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:50:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cc4dbc3b-5048-4be6-b511-8e90ef382678 tempest-VolumesListTestJSON-1656463937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-99dde1e5-1527-458e-9fa7-96634faeb120" returned: 0 in 2.845s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cc4dbc3b-5048-4be6-b511-8e90ef382678 tempest-VolumesListTestJSON-1656463937 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-99dde1e5-1527-458e-9fa7-96634faeb120 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cc4dbc3b-5048-4be6-b511-8e90ef382678 tempest-VolumesListTestJSON-1656463937 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-99dde1e5-1527-458e-9fa7-96634faeb120" returned: 0 in 0.463s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:17 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-cc4dbc3b-5048-4be6-b511-8e90ef382678 tempest-VolumesListTestJSON-1656463937 None] Lock "cinder-quobyte-99dde1e5-1527-458e-9fa7-96634faeb120" released by "delete_volume" :: held 4.187s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:50:18 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-cc4dbc3b-5048-4be6-b511-8e90ef382678 tempest-VolumesListTestJSON-1656463937 None] Created reservations ['882f80f3-e7b8-41fe-be03-77680f8c9990', '3a47e18b-c392-4513-9daf-2f12db2367eb', '008fa824-0353-4608-bc9a-f220611e0517', '1430b757-675c-43c5-a5d3-f822bfd57e38'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:50:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cc4dbc3b-5048-4be6-b511-8e90ef382678 tempest-VolumesListTestJSON-1656463937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:50:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cc4dbc3b-5048-4be6-b511-8e90ef382678 tempest-VolumesListTestJSON-1656463937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.027s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:50:18 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-cc4dbc3b-5048-4be6-b511-8e90ef382678 tempest-VolumesListTestJSON-1656463937 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:50:18 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-cc4dbc3b-5048-4be6-b511-8e90ef382678 tempest-VolumesListTestJSON-1656463937 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:50:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cc4dbc3b-5048-4be6-b511-8e90ef382678 tempest-VolumesListTestJSON-1656463937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:50:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cc4dbc3b-5048-4be6-b511-8e90ef382678 tempest-VolumesListTestJSON-1656463937 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cc4dbc3b-5048-4be6-b511-8e90ef382678 tempest-VolumesListTestJSON-1656463937 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.230s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:19 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-cc4dbc3b-5048-4be6-b511-8e90ef382678 tempest-VolumesListTestJSON-1656463937 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:50:19 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-cc4dbc3b-5048-4be6-b511-8e90ef382678 tempest-VolumesListTestJSON-1656463937 None] Deleted volume successfully.
Sep 10 11:50:20 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-0ea6bf62-dd3b-4d29-a6c4-4c930f680c25 tempest-VolumesListTestJSON-1656463937 None] Acquiring lock "cinder-1a2e0d58-0da4-4fd9-b35b-2ded491dad51-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:50:20 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-cc4dbc3b-5048-4be6-b511-8e90ef382678 tempest-VolumesListTestJSON-1656463937 None] Lock "cinder-99dde1e5-1527-458e-9fa7-96634faeb120-delete_volume" released by "delete_volume" :: held 7.434s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:50:20 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-0ea6bf62-dd3b-4d29-a6c4-4c930f680c25 tempest-VolumesListTestJSON-1656463937 None] Lock "cinder-1a2e0d58-0da4-4fd9-b35b-2ded491dad51-delete_volume" acquired by "delete_volume" :: waited 0.243s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:50:20 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-0ea6bf62-dd3b-4d29-a6c4-4c930f680c25 tempest-VolumesListTestJSON-1656463937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:50:20 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-0ea6bf62-dd3b-4d29-a6c4-4c930f680c25 tempest-VolumesListTestJSON-1656463937 None] Acquiring lock "cinder-quobyte-1a2e0d58-0da4-4fd9-b35b-2ded491dad51" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:50:20 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-0ea6bf62-dd3b-4d29-a6c4-4c930f680c25 tempest-VolumesListTestJSON-1656463937 None] Lock "cinder-quobyte-1a2e0d58-0da4-4fd9-b35b-2ded491dad51" acquired by "delete_volume" :: waited 0.027s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:50:20 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caa2453-2fc3-405a-9183-5c29dc8b68e7]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:50:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0ea6bf62-dd3b-4d29-a6c4-4c930f680c25 tempest-VolumesListTestJSON-1656463937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1a2e0d58-0da4-4fd9-b35b-2ded491dad51 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:21 devstack quobyte-client[82616]: System call of process 94080 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:50:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0ea6bf62-dd3b-4d29-a6c4-4c930f680c25 tempest-VolumesListTestJSON-1656463937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1a2e0d58-0da4-4fd9-b35b-2ded491dad51" returned: 0 in 0.828s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0ea6bf62-dd3b-4d29-a6c4-4c930f680c25 tempest-VolumesListTestJSON-1656463937 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1a2e0d58-0da4-4fd9-b35b-2ded491dad51 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0ea6bf62-dd3b-4d29-a6c4-4c930f680c25 tempest-VolumesListTestJSON-1656463937 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1a2e0d58-0da4-4fd9-b35b-2ded491dad51" returned: 0 in 0.213s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:22 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-0ea6bf62-dd3b-4d29-a6c4-4c930f680c25 tempest-VolumesListTestJSON-1656463937 None] Lock "cinder-quobyte-1a2e0d58-0da4-4fd9-b35b-2ded491dad51" released by "delete_volume" :: held 1.295s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:50:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:50:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:50:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:50:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:50:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:50:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:50:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 1.842s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:24 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:50:25 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-0ea6bf62-dd3b-4d29-a6c4-4c930f680c25 tempest-VolumesListTestJSON-1656463937 None] Created reservations ['9804f421-a918-419a-8f97-ecec014902e7', '844337de-ac04-421f-a552-7385db177aaf', 'e59738be-943a-44da-9b37-d5e449c17faf', 'efe34856-8979-473f-b561-0c7cbaf8eee7'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:50:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0ea6bf62-dd3b-4d29-a6c4-4c930f680c25 tempest-VolumesListTestJSON-1656463937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:50:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0ea6bf62-dd3b-4d29-a6c4-4c930f680c25 tempest-VolumesListTestJSON-1656463937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:50:25 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0ea6bf62-dd3b-4d29-a6c4-4c930f680c25 tempest-VolumesListTestJSON-1656463937 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:50:25 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0ea6bf62-dd3b-4d29-a6c4-4c930f680c25 tempest-VolumesListTestJSON-1656463937 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:50:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0ea6bf62-dd3b-4d29-a6c4-4c930f680c25 tempest-VolumesListTestJSON-1656463937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:50:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0ea6bf62-dd3b-4d29-a6c4-4c930f680c25 tempest-VolumesListTestJSON-1656463937 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0ea6bf62-dd3b-4d29-a6c4-4c930f680c25 tempest-VolumesListTestJSON-1656463937 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.161s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:26 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-0ea6bf62-dd3b-4d29-a6c4-4c930f680c25 tempest-VolumesListTestJSON-1656463937 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:50:26 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-0ea6bf62-dd3b-4d29-a6c4-4c930f680c25 tempest-VolumesListTestJSON-1656463937 None] Deleted volume successfully.
Sep 10 11:50:26 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1bb93b5f-fa01-4643-84d1-c25e14bac9a5 tempest-VolumesListTestJSON-1656463937 None] Acquiring lock "cinder-6a3a6e62-1aa5-46e7-a165-c6e70aadd0ee-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:50:26 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1bb93b5f-fa01-4643-84d1-c25e14bac9a5 tempest-VolumesListTestJSON-1656463937 None] Lock "cinder-6a3a6e62-1aa5-46e7-a165-c6e70aadd0ee-delete_volume" acquired by "delete_volume" :: waited 0.149s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:50:26 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-0ea6bf62-dd3b-4d29-a6c4-4c930f680c25 tempest-VolumesListTestJSON-1656463937 None] Lock "cinder-1a2e0d58-0da4-4fd9-b35b-2ded491dad51-delete_volume" released by "delete_volume" :: held 6.455s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:50:27 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=54,cinder:SELECT=30,cinder:INSERT=12,cinder:DELETE=5 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:50:27 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-1bb93b5f-fa01-4643-84d1-c25e14bac9a5 tempest-VolumesListTestJSON-1656463937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:50:27 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1bb93b5f-fa01-4643-84d1-c25e14bac9a5 tempest-VolumesListTestJSON-1656463937 None] Acquiring lock "cinder-quobyte-6a3a6e62-1aa5-46e7-a165-c6e70aadd0ee" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:50:27 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1bb93b5f-fa01-4643-84d1-c25e14bac9a5 tempest-VolumesListTestJSON-1656463937 None] Lock "cinder-quobyte-6a3a6e62-1aa5-46e7-a165-c6e70aadd0ee" acquired by "delete_volume" :: waited 0.045s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:50:27 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e63155b-fe3f-4557-904b-c7a5a0688620]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:50:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1bb93b5f-fa01-4643-84d1-c25e14bac9a5 tempest-VolumesListTestJSON-1656463937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6a3a6e62-1aa5-46e7-a165-c6e70aadd0ee {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1bb93b5f-fa01-4643-84d1-c25e14bac9a5 tempest-VolumesListTestJSON-1656463937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6a3a6e62-1aa5-46e7-a165-c6e70aadd0ee" returned: 0 in 1.100s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1bb93b5f-fa01-4643-84d1-c25e14bac9a5 tempest-VolumesListTestJSON-1656463937 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6a3a6e62-1aa5-46e7-a165-c6e70aadd0ee {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1bb93b5f-fa01-4643-84d1-c25e14bac9a5 tempest-VolumesListTestJSON-1656463937 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6a3a6e62-1aa5-46e7-a165-c6e70aadd0ee" returned: 0 in 0.202s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:28 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1bb93b5f-fa01-4643-84d1-c25e14bac9a5 tempest-VolumesListTestJSON-1656463937 None] Lock "cinder-quobyte-6a3a6e62-1aa5-46e7-a165-c6e70aadd0ee" released by "delete_volume" :: held 1.715s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:50:29 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=42,cinder:UPDATE=22,cinder:DELETE=3,cinder:INSERT=13 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:50:29 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-1bb93b5f-fa01-4643-84d1-c25e14bac9a5 tempest-VolumesListTestJSON-1656463937 None] Created reservations ['e0a7117d-a3ab-4800-953b-4b96cc0f8b3e', '886ca48e-d9df-44db-b879-dde947817624', '3b870d6f-b0a5-4ab4-a1ad-aa4af0758f8c', '8ddc3f7a-3885-4768-80e5-e7476930ca2b'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:50:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1bb93b5f-fa01-4643-84d1-c25e14bac9a5 tempest-VolumesListTestJSON-1656463937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:50:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1bb93b5f-fa01-4643-84d1-c25e14bac9a5 tempest-VolumesListTestJSON-1656463937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:50:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1bb93b5f-fa01-4643-84d1-c25e14bac9a5 tempest-VolumesListTestJSON-1656463937 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:50:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1bb93b5f-fa01-4643-84d1-c25e14bac9a5 tempest-VolumesListTestJSON-1656463937 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:50:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1bb93b5f-fa01-4643-84d1-c25e14bac9a5 tempest-VolumesListTestJSON-1656463937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:50:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1bb93b5f-fa01-4643-84d1-c25e14bac9a5 tempest-VolumesListTestJSON-1656463937 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1bb93b5f-fa01-4643-84d1-c25e14bac9a5 tempest-VolumesListTestJSON-1656463937 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.135s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:29 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-1bb93b5f-fa01-4643-84d1-c25e14bac9a5 tempest-VolumesListTestJSON-1656463937 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:50:29 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-1bb93b5f-fa01-4643-84d1-c25e14bac9a5 tempest-VolumesListTestJSON-1656463937 None] Deleted volume successfully.
Sep 10 11:50:30 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1bb93b5f-fa01-4643-84d1-c25e14bac9a5 tempest-VolumesListTestJSON-1656463937 None] Lock "cinder-6a3a6e62-1aa5-46e7-a165-c6e70aadd0ee-delete_volume" released by "delete_volume" :: held 3.085s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:50:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ff49c585-55ab-4980-96f2-7fe0ad57b6b7 tempest-AttachVolumeNegativeTest-1236938792 None] Acquiring lock "cinder-49e7d217-3a8c-486c-a446-e069bc44de4d-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:50:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ff49c585-55ab-4980-96f2-7fe0ad57b6b7 tempest-AttachVolumeNegativeTest-1236938792 None] Lock "cinder-49e7d217-3a8c-486c-a446-e069bc44de4d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:50:33 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-ff49c585-55ab-4980-96f2-7fe0ad57b6b7 tempest-AttachVolumeNegativeTest-1236938792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:50:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ff49c585-55ab-4980-96f2-7fe0ad57b6b7 tempest-AttachVolumeNegativeTest-1236938792 None] Acquiring lock "cinder-quobyte-49e7d217-3a8c-486c-a446-e069bc44de4d" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:50:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ff49c585-55ab-4980-96f2-7fe0ad57b6b7 tempest-AttachVolumeNegativeTest-1236938792 None] Lock "cinder-quobyte-49e7d217-3a8c-486c-a446-e069bc44de4d" acquired by "delete_volume" :: waited 0.018s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:50:33 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aec8e14-358d-4c7d-ad52-e53a307a47f6]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:50:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ff49c585-55ab-4980-96f2-7fe0ad57b6b7 tempest-AttachVolumeNegativeTest-1236938792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-49e7d217-3a8c-486c-a446-e069bc44de4d {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ff49c585-55ab-4980-96f2-7fe0ad57b6b7 tempest-AttachVolumeNegativeTest-1236938792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-49e7d217-3a8c-486c-a446-e069bc44de4d" returned: 0 in 0.602s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ff49c585-55ab-4980-96f2-7fe0ad57b6b7 tempest-AttachVolumeNegativeTest-1236938792 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-49e7d217-3a8c-486c-a446-e069bc44de4d {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ff49c585-55ab-4980-96f2-7fe0ad57b6b7 tempest-AttachVolumeNegativeTest-1236938792 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-49e7d217-3a8c-486c-a446-e069bc44de4d" returned: 0 in 0.118s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:34 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ff49c585-55ab-4980-96f2-7fe0ad57b6b7 tempest-AttachVolumeNegativeTest-1236938792 None] Lock "cinder-quobyte-49e7d217-3a8c-486c-a446-e069bc44de4d" released by "delete_volume" :: held 0.921s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:50:34 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-ff49c585-55ab-4980-96f2-7fe0ad57b6b7 tempest-AttachVolumeNegativeTest-1236938792 None] Created reservations ['cc5da2f8-8680-4319-a90b-7a0f90690bca', 'bb05e20a-c9d4-469a-931f-c9ad05b41efd', '167e6625-9bf7-4ede-8dd8-9726f617ffe4', 'e60df36d-2b7b-4aae-b238-c1c2ee06a152'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:50:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ff49c585-55ab-4980-96f2-7fe0ad57b6b7 tempest-AttachVolumeNegativeTest-1236938792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:50:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ff49c585-55ab-4980-96f2-7fe0ad57b6b7 tempest-AttachVolumeNegativeTest-1236938792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:50:34 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ff49c585-55ab-4980-96f2-7fe0ad57b6b7 tempest-AttachVolumeNegativeTest-1236938792 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:50:34 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ff49c585-55ab-4980-96f2-7fe0ad57b6b7 tempest-AttachVolumeNegativeTest-1236938792 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:50:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ff49c585-55ab-4980-96f2-7fe0ad57b6b7 tempest-AttachVolumeNegativeTest-1236938792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:50:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ff49c585-55ab-4980-96f2-7fe0ad57b6b7 tempest-AttachVolumeNegativeTest-1236938792 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ff49c585-55ab-4980-96f2-7fe0ad57b6b7 tempest-AttachVolumeNegativeTest-1236938792 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.329s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:35 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-ff49c585-55ab-4980-96f2-7fe0ad57b6b7 tempest-AttachVolumeNegativeTest-1236938792 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:50:35 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-ff49c585-55ab-4980-96f2-7fe0ad57b6b7 tempest-AttachVolumeNegativeTest-1236938792 None] Deleted volume successfully.
Sep 10 11:50:35 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:50:35 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:50:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Flow 'volume_create_manager' (55b615b7-29c8-4515-88ec-effae58bd8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:50:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce880d42-1a6e-45b2-b9ec-1e28a1bf0628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:50:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce880d42-1a6e-45b2-b9ec-1e28a1bf0628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1111928568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac2a5298-e7aa-4068-8c23-61b951bd25b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c132a94ff6aa4a73a8b85040ae752004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:50:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:50:35Z,use_quota=True,user_id='3b3450d7f8594357a7416850854f4b88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:50:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7deea046-23db-4106-8555-28c840b111a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:50:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7deea046-23db-4106-8555-28c840b111a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:50:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32efd74b-bc11-4af4-84fc-053d7fa38aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:50:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32efd74b-bc11-4af4-84fc-053d7fa38aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac2a5298-e7aa-4068-8c23-61b951bd25b1', 'volume_name': 'volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1', 'volume_size': 2}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:50:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d491bfea-c408-41a6-8241-00dcb7774598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:50:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d491bfea-c408-41a6-8241-00dcb7774598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:50:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3630df-bacf-441a-b277-46184416df8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:50:35 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Volume ac2a5298-e7aa-4068-8c23-61b951bd25b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1', 'volume_size': 2}
Sep 10 11:50:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:50:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:50:35 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1111928568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac2a5298-e7aa-4068-8c23-61b951bd25b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c132a94ff6aa4a73a8b85040ae752004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:50:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:50:35Z,use_quota=True,user_id='3b3450d7f8594357a7416850854f4b88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:50:35 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Creating volume ac2a5298-e7aa-4068-8c23-61b951bd25b1 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:50:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:50:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:50:35 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:50:35 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:50:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:50:35 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:50:35 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:50:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1 2147483648 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:35 devstack quobyte-client[82616]: System call of process 94111 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:50:35 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=73, name=volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:50:35 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ff49c585-55ab-4980-96f2-7fe0ad57b6b7 tempest-AttachVolumeNegativeTest-1236938792 None] Lock "cinder-49e7d217-3a8c-486c-a446-e069bc44de4d-delete_volume" released by "delete_volume" :: held 2.345s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:50:35 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a3df0976-b0e1-471e-b5f2-a1180fc9fccc tempest-AttachVolumeNegativeTest-1236938792 None] Acquiring lock "cinder-f912e96a-ded8-4d95-bf3c-eb085500e710-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:50:36 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a3df0976-b0e1-471e-b5f2-a1180fc9fccc tempest-AttachVolumeNegativeTest-1236938792 None] Lock "cinder-f912e96a-ded8-4d95-bf3c-eb085500e710-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:50:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1 2147483648" returned: 0 in 0.623s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1" returned: 0 in 0.286s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:36 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] <== create_volume: return (945ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:50:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:50:36 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-a3df0976-b0e1-471e-b5f2-a1180fc9fccc tempest-AttachVolumeNegativeTest-1236938792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:50:36 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a3df0976-b0e1-471e-b5f2-a1180fc9fccc tempest-AttachVolumeNegativeTest-1236938792 None] Acquiring lock "cinder-quobyte-f912e96a-ded8-4d95-bf3c-eb085500e710" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:50:36 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3630df-bacf-441a-b277-46184416df8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1', 'volume_size': 2}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:50:36 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4576ad7-893b-4ded-ab8e-4a26935db10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:50:36 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a3df0976-b0e1-471e-b5f2-a1180fc9fccc tempest-AttachVolumeNegativeTest-1236938792 None] Lock "cinder-quobyte-f912e96a-ded8-4d95-bf3c-eb085500e710" acquired by "delete_volume" :: waited 0.100s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:50:36 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Volume volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1 (ac2a5298-e7aa-4068-8c23-61b951bd25b1): created successfully
Sep 10 11:50:36 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4576ad7-893b-4ded-ab8e-4a26935db10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:50:36 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Flow 'volume_create_manager' (55b615b7-29c8-4515-88ec-effae58bd8c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:50:36 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b092efd-0d46-49e6-ad3b-b7633e02950f]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:50:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a3df0976-b0e1-471e-b5f2-a1180fc9fccc tempest-AttachVolumeNegativeTest-1236938792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f912e96a-ded8-4d95-bf3c-eb085500e710 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:36 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-0f5669a3-386e-4347-8dec-13fc58f263e2 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Created volume successfully.
Sep 10 11:50:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a3df0976-b0e1-471e-b5f2-a1180fc9fccc tempest-AttachVolumeNegativeTest-1236938792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f912e96a-ded8-4d95-bf3c-eb085500e710" returned: 0 in 0.577s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a3df0976-b0e1-471e-b5f2-a1180fc9fccc tempest-AttachVolumeNegativeTest-1236938792 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f912e96a-ded8-4d95-bf3c-eb085500e710 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a3df0976-b0e1-471e-b5f2-a1180fc9fccc tempest-AttachVolumeNegativeTest-1236938792 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f912e96a-ded8-4d95-bf3c-eb085500e710" returned: 0 in 0.144s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:37 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a3df0976-b0e1-471e-b5f2-a1180fc9fccc tempest-AttachVolumeNegativeTest-1236938792 None] Lock "cinder-quobyte-f912e96a-ded8-4d95-bf3c-eb085500e710" released by "delete_volume" :: held 1.026s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:50:37 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-29caeef7-70e2-4247-9e87-79a1185c041a tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:50:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-29caeef7-70e2-4247-9e87-79a1185c041a tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:50:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-29caeef7-70e2-4247-9e87-79a1185c041a tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:50:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-29caeef7-70e2-4247-9e87-79a1185c041a tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Creating offline snapshot 072ad722-99c2-4a7a-8d38-87bf7ad9f950 of volume ac2a5298-e7aa-4068-8c23-61b951bd25b1 {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 11:50:37 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf7debc-678d-486a-b337-e1ff9a96b5c4]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:50:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-29caeef7-70e2-4247-9e87-79a1185c041a tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:38 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-a3df0976-b0e1-471e-b5f2-a1180fc9fccc tempest-AttachVolumeNegativeTest-1236938792 None] Created reservations ['8e436d12-9378-434b-8b03-cd73419018b3', '3a4bbfaa-d8c1-4b65-a478-e638cf6425cd', '5a411a17-e099-4d9c-9aa0-9a8210b934ed', '091c82e0-2c42-4be9-a6d2-3b0489c0ced5'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:50:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-29caeef7-70e2-4247-9e87-79a1185c041a tempest-VolumesSnapshotNegativeTestJSON-871901897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1" returned: 0 in 0.564s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-29caeef7-70e2-4247-9e87-79a1185c041a tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1.072ad722-99c2-4a7a-8d38-87bf7ad9f950 2G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a3df0976-b0e1-471e-b5f2-a1180fc9fccc tempest-AttachVolumeNegativeTest-1236938792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:50:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a3df0976-b0e1-471e-b5f2-a1180fc9fccc tempest-AttachVolumeNegativeTest-1236938792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.024s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:50:38 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-a3df0976-b0e1-471e-b5f2-a1180fc9fccc tempest-AttachVolumeNegativeTest-1236938792 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:50:38 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-a3df0976-b0e1-471e-b5f2-a1180fc9fccc tempest-AttachVolumeNegativeTest-1236938792 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:50:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a3df0976-b0e1-471e-b5f2-a1180fc9fccc tempest-AttachVolumeNegativeTest-1236938792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:50:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a3df0976-b0e1-471e-b5f2-a1180fc9fccc tempest-AttachVolumeNegativeTest-1236938792 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:38 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=74, name=volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1.072ad722-99c2-4a7a-8d38-87bf7ad9f950, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:50:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-29caeef7-70e2-4247-9e87-79a1185c041a tempest-VolumesSnapshotNegativeTestJSON-871901897 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1.072ad722-99c2-4a7a-8d38-87bf7ad9f950 2G" returned: 0 in 0.326s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-29caeef7-70e2-4247-9e87-79a1185c041a tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1 -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1.072ad722-99c2-4a7a-8d38-87bf7ad9f950 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a3df0976-b0e1-471e-b5f2-a1180fc9fccc tempest-AttachVolumeNegativeTest-1236938792 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.205s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:39 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-a3df0976-b0e1-471e-b5f2-a1180fc9fccc tempest-AttachVolumeNegativeTest-1236938792 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:50:39 devstack quobyte-client[82616]: System call of process 94126 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:50:39 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-a3df0976-b0e1-471e-b5f2-a1180fc9fccc tempest-AttachVolumeNegativeTest-1236938792 None] Deleted volume successfully.
Sep 10 11:50:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-29caeef7-70e2-4247-9e87-79a1185c041a tempest-VolumesSnapshotNegativeTestJSON-871901897 None] CMD "qemu-img rebase -u -b volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1 -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1.072ad722-99c2-4a7a-8d38-87bf7ad9f950" returned: 0 in 0.424s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:39 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-29caeef7-70e2-4247-9e87-79a1185c041a tempest-VolumesSnapshotNegativeTestJSON-871901897 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1.072ad722-99c2-4a7a-8d38-87bf7ad9f950 is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:50:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-29caeef7-70e2-4247-9e87-79a1185c041a tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1.072ad722-99c2-4a7a-8d38-87bf7ad9f950 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-29caeef7-70e2-4247-9e87-79a1185c041a tempest-VolumesSnapshotNegativeTestJSON-871901897 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1.072ad722-99c2-4a7a-8d38-87bf7ad9f950" returned: 0 in 0.183s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:39 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-29caeef7-70e2-4247-9e87-79a1185c041a tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1 -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 11:50:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-29caeef7-70e2-4247-9e87-79a1185c041a tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1.072ad722-99c2-4a7a-8d38-87bf7ad9f950 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:39 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a3df0976-b0e1-471e-b5f2-a1180fc9fccc tempest-AttachVolumeNegativeTest-1236938792 None] Lock "cinder-f912e96a-ded8-4d95-bf3c-eb085500e710-delete_volume" released by "delete_volume" :: held 3.612s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:50:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-29caeef7-70e2-4247-9e87-79a1185c041a tempest-VolumesSnapshotNegativeTestJSON-871901897 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1.072ad722-99c2-4a7a-8d38-87bf7ad9f950" returned: 0 in 0.194s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-29caeef7-70e2-4247-9e87-79a1185c041a tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:39 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-168cda03-e2ad-4e9c-b2a3-2122d0183586 tempest-AttachVolumeNegativeTest-1236938792 None] Acquiring lock "cinder-3b4bf75e-0589-4b24-ac82-1118990a5276-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:50:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-29caeef7-70e2-4247-9e87-79a1185c041a tempest-VolumesSnapshotNegativeTestJSON-871901897 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1.info" returned: 0 in 0.281s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:40 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-29caeef7-70e2-4247-9e87-79a1185c041a tempest-VolumesSnapshotNegativeTestJSON-871901897 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1.info is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:50:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-29caeef7-70e2-4247-9e87-79a1185c041a tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:40 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-168cda03-e2ad-4e9c-b2a3-2122d0183586 tempest-AttachVolumeNegativeTest-1236938792 None] Lock "cinder-3b4bf75e-0589-4b24-ac82-1118990a5276-delete_volume" acquired by "delete_volume" :: waited 0.179s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:50:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-29caeef7-70e2-4247-9e87-79a1185c041a tempest-VolumesSnapshotNegativeTestJSON-871901897 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1.info" returned: 0 in 0.337s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-29caeef7-70e2-4247-9e87-79a1185c041a tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.525s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:50:40 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-29caeef7-70e2-4247-9e87-79a1185c041a tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Create snapshot completed successfully
Sep 10 11:50:40 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-168cda03-e2ad-4e9c-b2a3-2122d0183586 tempest-AttachVolumeNegativeTest-1236938792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:50:40 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-168cda03-e2ad-4e9c-b2a3-2122d0183586 tempest-AttachVolumeNegativeTest-1236938792 None] Acquiring lock "cinder-quobyte-3b4bf75e-0589-4b24-ac82-1118990a5276" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:50:40 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-168cda03-e2ad-4e9c-b2a3-2122d0183586 tempest-AttachVolumeNegativeTest-1236938792 None] Lock "cinder-quobyte-3b4bf75e-0589-4b24-ac82-1118990a5276" acquired by "delete_volume" :: waited 0.030s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:50:40 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17ce9e2-627e-4fe2-bd00-4b66c882318d]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:50:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-168cda03-e2ad-4e9c-b2a3-2122d0183586 tempest-AttachVolumeNegativeTest-1236938792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3b4bf75e-0589-4b24-ac82-1118990a5276 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-168cda03-e2ad-4e9c-b2a3-2122d0183586 tempest-AttachVolumeNegativeTest-1236938792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3b4bf75e-0589-4b24-ac82-1118990a5276" returned: 0 in 0.433s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-168cda03-e2ad-4e9c-b2a3-2122d0183586 tempest-AttachVolumeNegativeTest-1236938792 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3b4bf75e-0589-4b24-ac82-1118990a5276 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-168cda03-e2ad-4e9c-b2a3-2122d0183586 tempest-AttachVolumeNegativeTest-1236938792 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3b4bf75e-0589-4b24-ac82-1118990a5276" returned: 0 in 0.097s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:41 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-168cda03-e2ad-4e9c-b2a3-2122d0183586 tempest-AttachVolumeNegativeTest-1236938792 None] Lock "cinder-quobyte-3b4bf75e-0589-4b24-ac82-1118990a5276" released by "delete_volume" :: held 0.684s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:50:41 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-168cda03-e2ad-4e9c-b2a3-2122d0183586 tempest-AttachVolumeNegativeTest-1236938792 None] Created reservations ['492d4273-46c2-4ef0-a2d7-0d59a2956b19', '27e98f0f-8c68-4fbb-b332-d5441e774bc1', '00aed37d-f871-4f8b-bc4f-24873731208d', '8aaf80c2-9636-4d81-9867-fe018c366728'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:50:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-168cda03-e2ad-4e9c-b2a3-2122d0183586 tempest-AttachVolumeNegativeTest-1236938792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:50:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-168cda03-e2ad-4e9c-b2a3-2122d0183586 tempest-AttachVolumeNegativeTest-1236938792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:50:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-168cda03-e2ad-4e9c-b2a3-2122d0183586 tempest-AttachVolumeNegativeTest-1236938792 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:50:42 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-168cda03-e2ad-4e9c-b2a3-2122d0183586 tempest-AttachVolumeNegativeTest-1236938792 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:50:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-168cda03-e2ad-4e9c-b2a3-2122d0183586 tempest-AttachVolumeNegativeTest-1236938792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:50:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-168cda03-e2ad-4e9c-b2a3-2122d0183586 tempest-AttachVolumeNegativeTest-1236938792 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:42 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ba16b248-9917-42d7-bd4e-4d174c1349b7 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Acquiring lock "cinder-072ad722-99c2-4a7a-8d38-87bf7ad9f950-delete_snapshot" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:50:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-168cda03-e2ad-4e9c-b2a3-2122d0183586 tempest-AttachVolumeNegativeTest-1236938792 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.352s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:42 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-168cda03-e2ad-4e9c-b2a3-2122d0183586 tempest-AttachVolumeNegativeTest-1236938792 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:50:42 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-168cda03-e2ad-4e9c-b2a3-2122d0183586 tempest-AttachVolumeNegativeTest-1236938792 None] Deleted volume successfully.
Sep 10 11:50:42 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ba16b248-9917-42d7-bd4e-4d174c1349b7 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Lock "cinder-072ad722-99c2-4a7a-8d38-87bf7ad9f950-delete_snapshot" acquired by "delete_snapshot" :: waited 0.248s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:50:42 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-ba16b248-9917-42d7-bd4e-4d174c1349b7 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:50:42 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ba16b248-9917-42d7-bd4e-4d174c1349b7 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Acquiring lock "cinder-quobyte-ac2a5298-e7aa-4068-8c23-61b951bd25b1" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:50:42 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ba16b248-9917-42d7-bd4e-4d174c1349b7 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Lock "cinder-quobyte-ac2a5298-e7aa-4068-8c23-61b951bd25b1" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:50:42 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ba16b248-9917-42d7-bd4e-4d174c1349b7 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Acquiring lock "cinder-quobyte-072ad722-99c2-4a7a-8d38-87bf7ad9f950" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:50:42 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-168cda03-e2ad-4e9c-b2a3-2122d0183586 tempest-AttachVolumeNegativeTest-1236938792 None] Lock "cinder-3b4bf75e-0589-4b24-ac82-1118990a5276-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:50:42 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ba16b248-9917-42d7-bd4e-4d174c1349b7 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Lock "cinder-quobyte-072ad722-99c2-4a7a-8d38-87bf7ad9f950" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:50:42 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-ba16b248-9917-42d7-bd4e-4d174c1349b7 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Deleting offline snapshot 072ad722-99c2-4a7a-8d38-87bf7ad9f950 of volume ac2a5298-e7aa-4068-8c23-61b951bd25b1 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 11:50:42 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-ba16b248-9917-42d7-bd4e-4d174c1349b7 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] snapshot_file for this snap is: volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1.072ad722-99c2-4a7a-8d38-87bf7ad9f950 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 11:50:42 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abd7e1a-cef3-4415-b7f3-0d48d0985b5f]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:50:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ba16b248-9917-42d7-bd4e-4d174c1349b7 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1.072ad722-99c2-4a7a-8d38-87bf7ad9f950 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ba16b248-9917-42d7-bd4e-4d174c1349b7 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1.072ad722-99c2-4a7a-8d38-87bf7ad9f950" returned: 0 in 0.522s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:43 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-ba16b248-9917-42d7-bd4e-4d174c1349b7 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:50:43 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e33d57e-5e14-41ee-bec4-647fe05e9ba9]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:50:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ba16b248-9917-42d7-bd4e-4d174c1349b7 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ba16b248-9917-42d7-bd4e-4d174c1349b7 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1" returned: 0 in 0.649s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ba16b248-9917-42d7-bd4e-4d174c1349b7 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1.072ad722-99c2-4a7a-8d38-87bf7ad9f950 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ba16b248-9917-42d7-bd4e-4d174c1349b7 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1.072ad722-99c2-4a7a-8d38-87bf7ad9f950" returned: 0 in 0.441s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ba16b248-9917-42d7-bd4e-4d174c1349b7 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1.072ad722-99c2-4a7a-8d38-87bf7ad9f950 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ba16b248-9917-42d7-bd4e-4d174c1349b7 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1.072ad722-99c2-4a7a-8d38-87bf7ad9f950" returned: 0 in 0.132s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:44 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ba16b248-9917-42d7-bd4e-4d174c1349b7 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Lock "cinder-quobyte-072ad722-99c2-4a7a-8d38-87bf7ad9f950" released by "_delete_snapshot" :: held 2.217s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:50:44 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ba16b248-9917-42d7-bd4e-4d174c1349b7 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Lock "cinder-quobyte-ac2a5298-e7aa-4068-8c23-61b951bd25b1" released by "delete_snapshot" :: held 2.269s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:50:45 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-ba16b248-9917-42d7-bd4e-4d174c1349b7 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Created reservations ['d716dda8-8a1e-4159-8832-5eaa49bfb0fd', '10bf0eaa-a2e3-4400-9b47-839c1fcdaf5a', '4d33dc50-7b1c-4989-bf83-db3859a6a243', 'da8aff1e-88f0-4b31-8967-6a823fa7f8c5'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:50:45 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-ba16b248-9917-42d7-bd4e-4d174c1349b7 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Delete snapshot completed successfully.
Sep 10 11:50:45 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ba16b248-9917-42d7-bd4e-4d174c1349b7 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Lock "cinder-072ad722-99c2-4a7a-8d38-87bf7ad9f950-delete_snapshot" released by "delete_snapshot" :: held 3.327s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:50:46 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5314a55e-b864-4903-83bb-46aedaf16792 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Acquiring lock "cinder-ac2a5298-e7aa-4068-8c23-61b951bd25b1-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:50:46 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5314a55e-b864-4903-83bb-46aedaf16792 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Lock "cinder-ac2a5298-e7aa-4068-8c23-61b951bd25b1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:50:46 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-5314a55e-b864-4903-83bb-46aedaf16792 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:50:46 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5314a55e-b864-4903-83bb-46aedaf16792 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Acquiring lock "cinder-quobyte-ac2a5298-e7aa-4068-8c23-61b951bd25b1" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:50:46 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5314a55e-b864-4903-83bb-46aedaf16792 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Lock "cinder-quobyte-ac2a5298-e7aa-4068-8c23-61b951bd25b1" acquired by "delete_volume" :: waited 0.021s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:50:47 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8d20de-4726-4bde-bd07-c3a4998d71de]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:50:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5314a55e-b864-4903-83bb-46aedaf16792 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5314a55e-b864-4903-83bb-46aedaf16792 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1" returned: 0 in 0.771s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5314a55e-b864-4903-83bb-46aedaf16792 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5314a55e-b864-4903-83bb-46aedaf16792 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ac2a5298-e7aa-4068-8c23-61b951bd25b1" returned: 0 in 0.226s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:48 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5314a55e-b864-4903-83bb-46aedaf16792 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Lock "cinder-quobyte-ac2a5298-e7aa-4068-8c23-61b951bd25b1" released by "delete_volume" :: held 1.270s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:50:48 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-5314a55e-b864-4903-83bb-46aedaf16792 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Created reservations ['b904f9a7-5bc5-41f6-8440-58fa688d4762', '3240bb1b-f60a-4650-8735-a4cabe8a7344', '2915bd93-ea44-4ca5-a6c4-611278dce332', 'd4933aef-552c-4ebb-9d06-08b66c9ff2b5'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:50:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5314a55e-b864-4903-83bb-46aedaf16792 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:50:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5314a55e-b864-4903-83bb-46aedaf16792 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:50:48 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5314a55e-b864-4903-83bb-46aedaf16792 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:50:48 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5314a55e-b864-4903-83bb-46aedaf16792 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:50:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5314a55e-b864-4903-83bb-46aedaf16792 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:50:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5314a55e-b864-4903-83bb-46aedaf16792 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5314a55e-b864-4903-83bb-46aedaf16792 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.156s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:49 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-5314a55e-b864-4903-83bb-46aedaf16792 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:50:49 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-5314a55e-b864-4903-83bb-46aedaf16792 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Deleted volume successfully.
Sep 10 11:50:49 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-1b68de01-5a5e-45d1-9897-06ff36e3d76e req-2e1efe47-a2fa-4d78-803c-6c19ee75f4eb tempest-TestMinimumBasicScenario-1106895519 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:50:49 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5314a55e-b864-4903-83bb-46aedaf16792 tempest-VolumesSnapshotNegativeTestJSON-871901897 None] Lock "cinder-ac2a5298-e7aa-4068-8c23-61b951bd25b1-delete_volume" released by "delete_volume" :: held 2.907s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:50:49 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-1b68de01-5a5e-45d1-9897-06ff36e3d76e req-2e1efe47-a2fa-4d78-803c-6c19ee75f4eb tempest-TestMinimumBasicScenario-1106895519 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:50:49 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-1b68de01-5a5e-45d1-9897-06ff36e3d76e req-2e1efe47-a2fa-4d78-803c-6c19ee75f4eb tempest-TestMinimumBasicScenario-1106895519 None] Terminate volume connection completed successfully.
Sep 10 11:50:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-1b68de01-5a5e-45d1-9897-06ff36e3d76e req-2e1efe47-a2fa-4d78-803c-6c19ee75f4eb tempest-TestMinimumBasicScenario-1106895519 None] Deleting attachment ee5f5d77-1a30-4f6c-892d-de97419ef1e3. {{(pid=82594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 11:50:52 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-c4eee024-fdba-4b1c-8be1-f5fa53334c58 tempest-TestMinimumBasicScenario-1106895519 None] Acquiring lock "cinder-3b67046c-56d0-4050-be7b-09df4ad02bfb-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:50:52 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-c4eee024-fdba-4b1c-8be1-f5fa53334c58 tempest-TestMinimumBasicScenario-1106895519 None] Lock "cinder-3b67046c-56d0-4050-be7b-09df4ad02bfb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:50:52 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-c4eee024-fdba-4b1c-8be1-f5fa53334c58 tempest-TestMinimumBasicScenario-1106895519 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:50:52 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-c4eee024-fdba-4b1c-8be1-f5fa53334c58 tempest-TestMinimumBasicScenario-1106895519 None] Acquiring lock "cinder-quobyte-3b67046c-56d0-4050-be7b-09df4ad02bfb" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:50:52 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-c4eee024-fdba-4b1c-8be1-f5fa53334c58 tempest-TestMinimumBasicScenario-1106895519 None] Lock "cinder-quobyte-3b67046c-56d0-4050-be7b-09df4ad02bfb" acquired by "delete_volume" :: waited 0.021s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:50:52 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7b0f65-c078-4130-bcb9-ea4a7360f4cb]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:50:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c4eee024-fdba-4b1c-8be1-f5fa53334c58 tempest-TestMinimumBasicScenario-1106895519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3b67046c-56d0-4050-be7b-09df4ad02bfb {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c4eee024-fdba-4b1c-8be1-f5fa53334c58 tempest-TestMinimumBasicScenario-1106895519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3b67046c-56d0-4050-be7b-09df4ad02bfb" returned: 0 in 0.588s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c4eee024-fdba-4b1c-8be1-f5fa53334c58 tempest-TestMinimumBasicScenario-1106895519 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3b67046c-56d0-4050-be7b-09df4ad02bfb {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c4eee024-fdba-4b1c-8be1-f5fa53334c58 tempest-TestMinimumBasicScenario-1106895519 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3b67046c-56d0-4050-be7b-09df4ad02bfb" returned: 0 in 0.138s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:53 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-c4eee024-fdba-4b1c-8be1-f5fa53334c58 tempest-TestMinimumBasicScenario-1106895519 None] Lock "cinder-quobyte-3b67046c-56d0-4050-be7b-09df4ad02bfb" released by "delete_volume" :: held 1.000s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:50:54 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-c4eee024-fdba-4b1c-8be1-f5fa53334c58 tempest-TestMinimumBasicScenario-1106895519 None] Created reservations ['bb5e5802-79c7-4bd1-865c-380b655a3231', 'c8fc260b-7cc8-4f70-8f79-40b3df6bc7f4', '2df39a51-b058-4879-b7e9-4fcfcaec1399', '20f48941-15fd-4574-8334-0cf12c2e52af'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:50:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-c4eee024-fdba-4b1c-8be1-f5fa53334c58 tempest-TestMinimumBasicScenario-1106895519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:50:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-c4eee024-fdba-4b1c-8be1-f5fa53334c58 tempest-TestMinimumBasicScenario-1106895519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:50:54 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-c4eee024-fdba-4b1c-8be1-f5fa53334c58 tempest-TestMinimumBasicScenario-1106895519 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:50:54 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-c4eee024-fdba-4b1c-8be1-f5fa53334c58 tempest-TestMinimumBasicScenario-1106895519 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:50:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-c4eee024-fdba-4b1c-8be1-f5fa53334c58 tempest-TestMinimumBasicScenario-1106895519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:50:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c4eee024-fdba-4b1c-8be1-f5fa53334c58 tempest-TestMinimumBasicScenario-1106895519 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:50:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c4eee024-fdba-4b1c-8be1-f5fa53334c58 tempest-TestMinimumBasicScenario-1106895519 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.132s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:50:54 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-c4eee024-fdba-4b1c-8be1-f5fa53334c58 tempest-TestMinimumBasicScenario-1106895519 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:50:54 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-c4eee024-fdba-4b1c-8be1-f5fa53334c58 tempest-TestMinimumBasicScenario-1106895519 None] Deleted volume successfully.
Sep 10 11:50:54 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-c4eee024-fdba-4b1c-8be1-f5fa53334c58 tempest-TestMinimumBasicScenario-1106895519 None] Lock "cinder-3b67046c-56d0-4050-be7b-09df4ad02bfb-delete_volume" released by "delete_volume" :: held 2.222s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:50:58 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-1186cf28-cbf0-4414-bb63-9f3f8aaeba42 tempest-GroupSnapshotsTest-789445324 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:50:58 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-1186cf28-cbf0-4414-bb63-9f3f8aaeba42 tempest-GroupSnapshotsTest-789445324 None] Group tempest-GroupSnapshotsTest-Group-1525943183: creating
Sep 10 11:50:58 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-1186cf28-cbf0-4414-bb63-9f3f8aaeba42 tempest-GroupSnapshotsTest-789445324 None] Group tempest-GroupSnapshotsTest-Group-1525943183: created successfully
Sep 10 11:50:58 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-1186cf28-cbf0-4414-bb63-9f3f8aaeba42 tempest-GroupSnapshotsTest-789445324 None] Create group completed successfully.
Sep 10 11:51:00 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:51:00 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:51:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Flow 'volume_create_manager' (b88fe34f-a888-4f1d-b669-2439f68a7eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:51:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d295064-bc26-461d-b1f5-129babcdfbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d295064-bc26-461d-b1f5-129babcdfbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1052369813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=435f77fc-829d-4eea-bb1b-a6a075bf73be,host='devstack@QuobyteHD#QuobyteHD',id=47e6f095-77f3-4e5b-9441-b42aedc012a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac38359325e74533ba6c6d5776059be0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:51:00Z,use_quota=True,user_id='354ff4aee9a84a0bbdf1b5a3720ed108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(928bf647-6fa2-41e9-a071-4e93f818673a),volume_type_id=928bf647-6fa2-41e9-a071-4e93f818673a)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b20987-bba9-40ac-b1cc-ade79f4fb384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b20987-bba9-40ac-b1cc-ade79f4fb384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f02e92-8ca8-4134-830f-6ccaf5b6868d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f02e92-8ca8-4134-830f-6ccaf5b6868d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47e6f095-77f3-4e5b-9441-b42aedc012a2', 'volume_name': 'volume-47e6f095-77f3-4e5b-9441-b42aedc012a2', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e7128c-000c-46b1-9eda-7b4f30101889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e7128c-000c-46b1-9eda-7b4f30101889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c026a9-3a87-458d-a209-4874ca2501b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:00 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Volume 47e6f095-77f3-4e5b-9441-b42aedc012a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47e6f095-77f3-4e5b-9441-b42aedc012a2', 'volume_size': 1}
Sep 10 11:51:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:51:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:51:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=435f77fc-829d-4eea-bb1b-a6a075bf73be,created_at=2025-09-10T09:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1052369813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=435f77fc-829d-4eea-bb1b-a6a075bf73be,host='devstack@QuobyteHD#QuobyteHD',id=47e6f095-77f3-4e5b-9441-b42aedc012a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac38359325e74533ba6c6d5776059be0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:51:00Z,use_quota=True,user_id='354ff4aee9a84a0bbdf1b5a3720ed108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(928bf647-6fa2-41e9-a071-4e93f818673a),volume_type_id=928bf647-6fa2-41e9-a071-4e93f818673a)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:51:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Creating volume 47e6f095-77f3-4e5b-9441-b42aedc012a2 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:51:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:51:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:51:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:51:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:51:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:51:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:51:00 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:51:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:00 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=76, name=volume-47e6f095-77f3-4e5b-9441-b42aedc012a2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:51:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2 1073741824" returned: 0 in 0.462s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2" returned: 0 in 0.237s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:01 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] <== create_volume: return (814ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:51:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:51:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c026a9-3a87-458d-a209-4874ca2501b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47e6f095-77f3-4e5b-9441-b42aedc012a2', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfc88ef-5c28-4bf0-84d5-bc1700f223fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:01 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Volume volume-47e6f095-77f3-4e5b-9441-b42aedc012a2 (47e6f095-77f3-4e5b-9441-b42aedc012a2): created successfully
Sep 10 11:51:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfc88ef-5c28-4bf0-84d5-bc1700f223fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Flow 'volume_create_manager' (b88fe34f-a888-4f1d-b669-2439f68a7eed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:51:02 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-e7e2442f-5c14-4e42-8727-60cf78e31218 tempest-GroupSnapshotsTest-789445324 None] Created volume successfully.
Sep 10 11:51:03 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-ec60b571-1e61-46b0-bead-5d0b64d0b6bb tempest-GroupSnapshotsTest-789445324 None] GroupSnapshot 62ccf065-644c-483f-9dc5-f7752aff6a12: creating.
Sep 10 11:51:03 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-ec60b571-1e61-46b0-bead-5d0b64d0b6bb tempest-GroupSnapshotsTest-789445324 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:51:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ec60b571-1e61-46b0-bead-5d0b64d0b6bb tempest-GroupSnapshotsTest-789445324 None] Group snapshot 62ccf065-644c-483f-9dc5-f7752aff6a12: creating. {{(pid=82594) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 10 11:51:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ec60b571-1e61-46b0-bead-5d0b64d0b6bb tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:51:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ec60b571-1e61-46b0-bead-5d0b64d0b6bb tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:51:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-ec60b571-1e61-46b0-bead-5d0b64d0b6bb tempest-GroupSnapshotsTest-789445324 None] Creating offline snapshot 483cf18e-2c70-4ec0-a32d-279be9328b35 of volume 47e6f095-77f3-4e5b-9441-b42aedc012a2 {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 11:51:03 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20289cb-b412-474e-a2d0-ab3ba580bc58]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:51:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ec60b571-1e61-46b0-bead-5d0b64d0b6bb tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:04 devstack quobyte-client[82616]: System call of process 94255 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:51:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ec60b571-1e61-46b0-bead-5d0b64d0b6bb tempest-GroupSnapshotsTest-789445324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2" returned: 0 in 0.769s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ec60b571-1e61-46b0-bead-5d0b64d0b6bb tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2.483cf18e-2c70-4ec0-a32d-279be9328b35 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:04 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=77, name=volume-47e6f095-77f3-4e5b-9441-b42aedc012a2.483cf18e-2c70-4ec0-a32d-279be9328b35, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:51:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ec60b571-1e61-46b0-bead-5d0b64d0b6bb tempest-GroupSnapshotsTest-789445324 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2.483cf18e-2c70-4ec0-a32d-279be9328b35 1G" returned: 0 in 0.353s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ec60b571-1e61-46b0-bead-5d0b64d0b6bb tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): qemu-img rebase -u -b volume-47e6f095-77f3-4e5b-9441-b42aedc012a2 -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2.483cf18e-2c70-4ec0-a32d-279be9328b35 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:04 devstack quobyte-client[82616]: System call of process 94261 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:51:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ec60b571-1e61-46b0-bead-5d0b64d0b6bb tempest-GroupSnapshotsTest-789445324 None] CMD "qemu-img rebase -u -b volume-47e6f095-77f3-4e5b-9441-b42aedc012a2 -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2.483cf18e-2c70-4ec0-a32d-279be9328b35" returned: 0 in 0.221s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:04 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-ec60b571-1e61-46b0-bead-5d0b64d0b6bb tempest-GroupSnapshotsTest-789445324 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2.483cf18e-2c70-4ec0-a32d-279be9328b35 is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:51:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ec60b571-1e61-46b0-bead-5d0b64d0b6bb tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2.483cf18e-2c70-4ec0-a32d-279be9328b35 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ec60b571-1e61-46b0-bead-5d0b64d0b6bb tempest-GroupSnapshotsTest-789445324 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2.483cf18e-2c70-4ec0-a32d-279be9328b35" returned: 0 in 0.139s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:05 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-ec60b571-1e61-46b0-bead-5d0b64d0b6bb tempest-GroupSnapshotsTest-789445324 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2 -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 11:51:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ec60b571-1e61-46b0-bead-5d0b64d0b6bb tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2.483cf18e-2c70-4ec0-a32d-279be9328b35 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ec60b571-1e61-46b0-bead-5d0b64d0b6bb tempest-GroupSnapshotsTest-789445324 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2.483cf18e-2c70-4ec0-a32d-279be9328b35" returned: 0 in 0.183s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ec60b571-1e61-46b0-bead-5d0b64d0b6bb tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ec60b571-1e61-46b0-bead-5d0b64d0b6bb tempest-GroupSnapshotsTest-789445324 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2.info" returned: 0 in 0.152s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:05 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-ec60b571-1e61-46b0-bead-5d0b64d0b6bb tempest-GroupSnapshotsTest-789445324 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2.info is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:51:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ec60b571-1e61-46b0-bead-5d0b64d0b6bb tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ec60b571-1e61-46b0-bead-5d0b64d0b6bb tempest-GroupSnapshotsTest-789445324 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2.info" returned: 0 in 0.134s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ec60b571-1e61-46b0-bead-5d0b64d0b6bb tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.349s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:51:06 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-ec60b571-1e61-46b0-bead-5d0b64d0b6bb tempest-GroupSnapshotsTest-789445324 None] group_snapshot 62ccf065-644c-483f-9dc5-f7752aff6a12: created successfully
Sep 10 11:51:08 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:51:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:51:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:51:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "cinder-quobyte-483cf18e-2c70-4ec0-a32d-279be9328b35-22e76550-5181-4fa7-ae20-ec58e3cb24ae" by "_create_volume_from_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:51:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-483cf18e-2c70-4ec0-a32d-279be9328b35-22e76550-5181-4fa7-ae20-ec58e3cb24ae" acquired by "_create_volume_from_snapshot" :: waited 0.095s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:51:08 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Creating volume 22e76550-5181-4fa7-ae20-ec58e3cb24ae from snapshot 483cf18e-2c70-4ec0-a32d-279be9328b35 {{(pid=82594) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 10 11:51:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:51:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:51:08 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:51:08 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:51:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:51:08 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:51:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "cinder-quobyte-22e76550-5181-4fa7-ae20-ec58e3cb24ae" by "_copy_volume_from_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:51:09 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-22e76550-5181-4fa7-ae20-ec58e3cb24ae" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:51:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] snapshot: 483cf18e-2c70-4ec0-a32d-279be9328b35, volume: 22e76550-5181-4fa7-ae20-ec58e3cb24ae,  {{(pid=82594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 10 11:51:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:51:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:51:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:51:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:51:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:51:09 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cb4cc4-a0c8-4146-a62a-0c77042b2ceb]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:51:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2.483cf18e-2c70-4ec0-a32d-279be9328b35 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:09 devstack quobyte-client[82616]: System call of process 94269 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:51:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2.483cf18e-2c70-4ec0-a32d-279be9328b35" returned: 0 in 0.743s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47e6f095-77f3-4e5b-9441-b42aedc012a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:51:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2 {{(pid=82594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 10 11:51:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Creating direct copy from snapshot {{(pid=82594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 10 11:51:10 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[59108c74-ee1b-492d-bfd1-49735417ac3f]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:51:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2" returned: 0 in 0.566s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:10 devstack cinder-volume[82594]: DEBUG cinder.utils [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-22e76550-5181-4fa7-ae20-ec58e3cb24ae not found in is_blk_device check {{(pid=82594) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 10 11:51:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-22e76550-5181-4fa7-ae20-ec58e3cb24ae {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:10 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=79, name=volume-22e76550-5181-4fa7-ae20-ec58e3cb24ae, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:51:19 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=53,cinder:INSERT=18,cinder:UPDATE=65,cinder:DELETE=3 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:51:19 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=56,cinder:SELECT=40,cinder:DELETE=6,cinder:INSERT=10 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:51:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-22e76550-5181-4fa7-ae20-ec58e3cb24ae" returned: 0 in 9.541s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:20 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bbad78-9527-4742-b9c5-8eeed15d6b71]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:51:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:21 devstack quobyte-client[82616]: System call of process 94290 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:51:21 devstack quobyte-client[82616]: System call of process 94290 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:51:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2" returned: 0 in 1.103s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:21 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Image conversion details: src /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2, size 1024.00 MB, duration 9.55 sec, destination /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-22e76550-5181-4fa7-ae20-ec58e3cb24ae {{(pid=82594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 11:51:21 devstack cinder-volume[82594]: INFO cinder.image.image_utils [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Converted 1024.00 MB image at 107.22 MB/s
Sep 10 11:51:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-22e76550-5181-4fa7-ae20-ec58e3cb24ae is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:51:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-22e76550-5181-4fa7-ae20-ec58e3cb24ae {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-22e76550-5181-4fa7-ae20-ec58e3cb24ae" returned: 0 in 0.175s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:21 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-22e76550-5181-4fa7-ae20-ec58e3cb24ae" released by "_copy_volume_from_snapshot" :: held 12.808s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:51:21 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-483cf18e-2c70-4ec0-a32d-279be9328b35-22e76550-5181-4fa7-ae20-ec58e3cb24ae" released by "_create_volume_from_snapshot" :: held 12.888s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:51:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:51:22 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-b020915f-f375-4957-a60b-bf5a4949d93b tempest-GroupSnapshotsTest-789445324 None] Create group from source-snapshot-62ccf065-644c-483f-9dc5-f7752aff6a12 completed successfully.
Sep 10 11:51:23 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-ca17a2f0-7074-4d9d-93ee-4561ccbf169a tempest-GroupSnapshotsTest-789445324 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:51:23 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ca17a2f0-7074-4d9d-93ee-4561ccbf169a tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "cinder-quobyte-22e76550-5181-4fa7-ae20-ec58e3cb24ae" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:51:23 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ca17a2f0-7074-4d9d-93ee-4561ccbf169a tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-22e76550-5181-4fa7-ae20-ec58e3cb24ae" acquired by "delete_volume" :: waited 0.040s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:51:23 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[124eccea-a7dd-4e7f-9803-0d00dfeaab82]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:51:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ca17a2f0-7074-4d9d-93ee-4561ccbf169a tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-22e76550-5181-4fa7-ae20-ec58e3cb24ae {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ca17a2f0-7074-4d9d-93ee-4561ccbf169a tempest-GroupSnapshotsTest-789445324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-22e76550-5181-4fa7-ae20-ec58e3cb24ae" returned: 0 in 0.607s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ca17a2f0-7074-4d9d-93ee-4561ccbf169a tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-22e76550-5181-4fa7-ae20-ec58e3cb24ae {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ca17a2f0-7074-4d9d-93ee-4561ccbf169a tempest-GroupSnapshotsTest-789445324 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-22e76550-5181-4fa7-ae20-ec58e3cb24ae" returned: 0 in 0.133s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:24 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ca17a2f0-7074-4d9d-93ee-4561ccbf169a tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-22e76550-5181-4fa7-ae20-ec58e3cb24ae" released by "delete_volume" :: held 0.995s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:51:25 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-ca17a2f0-7074-4d9d-93ee-4561ccbf169a tempest-GroupSnapshotsTest-789445324 None] Created reservations ['418cac9f-a37e-4754-82f8-47d3d15ce7ea'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:51:25 devstack cinder-volume[82594]: WARNING cinder.quota [None req-ca17a2f0-7074-4d9d-93ee-4561ccbf169a tempest-GroupSnapshotsTest-789445324 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-944090336 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-944090336, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:51:25 devstack cinder-volume[82594]: WARNING cinder.quota [None req-ca17a2f0-7074-4d9d-93ee-4561ccbf169a tempest-GroupSnapshotsTest-789445324 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-944090336 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-944090336, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:51:25 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-ca17a2f0-7074-4d9d-93ee-4561ccbf169a tempest-GroupSnapshotsTest-789445324 None] Created reservations ['6ea1edca-1c5e-4eac-bdb2-445547dc0f62', 'bd8ddaed-dbbc-4743-aa43-ed2502c59f1a', '2c5bc4ba-6399-4041-82a0-bdfd9fac50e4', 'd7cedb28-ba15-467e-bfa7-36628f739711'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:51:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ca17a2f0-7074-4d9d-93ee-4561ccbf169a tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:51:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ca17a2f0-7074-4d9d-93ee-4561ccbf169a tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:51:25 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ca17a2f0-7074-4d9d-93ee-4561ccbf169a tempest-GroupSnapshotsTest-789445324 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:51:25 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ca17a2f0-7074-4d9d-93ee-4561ccbf169a tempest-GroupSnapshotsTest-789445324 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:51:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ca17a2f0-7074-4d9d-93ee-4561ccbf169a tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:51:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ca17a2f0-7074-4d9d-93ee-4561ccbf169a tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ca17a2f0-7074-4d9d-93ee-4561ccbf169a tempest-GroupSnapshotsTest-789445324 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.174s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:25 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-ca17a2f0-7074-4d9d-93ee-4561ccbf169a tempest-GroupSnapshotsTest-789445324 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:51:26 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-ca17a2f0-7074-4d9d-93ee-4561ccbf169a tempest-GroupSnapshotsTest-789445324 None] Delete group completed successfully.
Sep 10 11:51:26 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-2047b3cb-5ec7-4ea1-b920-d8e26dc5f1f6 tempest-GroupSnapshotsTest-789445324 None] group_snapshot 62ccf065-644c-483f-9dc5-f7752aff6a12: deleting
Sep 10 11:51:26 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-2047b3cb-5ec7-4ea1-b920-d8e26dc5f1f6 tempest-GroupSnapshotsTest-789445324 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:51:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2047b3cb-5ec7-4ea1-b920-d8e26dc5f1f6 tempest-GroupSnapshotsTest-789445324 None] group_snapshot 62ccf065-644c-483f-9dc5-f7752aff6a12: deleting {{(pid=82594) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 10 11:51:26 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2047b3cb-5ec7-4ea1-b920-d8e26dc5f1f6 tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "cinder-quobyte-47e6f095-77f3-4e5b-9441-b42aedc012a2" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:51:26 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2047b3cb-5ec7-4ea1-b920-d8e26dc5f1f6 tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-47e6f095-77f3-4e5b-9441-b42aedc012a2" acquired by "delete_snapshot" :: waited 0.117s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:51:26 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2047b3cb-5ec7-4ea1-b920-d8e26dc5f1f6 tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "cinder-quobyte-483cf18e-2c70-4ec0-a32d-279be9328b35" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:51:26 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2047b3cb-5ec7-4ea1-b920-d8e26dc5f1f6 tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-483cf18e-2c70-4ec0-a32d-279be9328b35" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:51:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-2047b3cb-5ec7-4ea1-b920-d8e26dc5f1f6 tempest-GroupSnapshotsTest-789445324 None] Deleting offline snapshot 483cf18e-2c70-4ec0-a32d-279be9328b35 of volume 47e6f095-77f3-4e5b-9441-b42aedc012a2 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 11:51:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-2047b3cb-5ec7-4ea1-b920-d8e26dc5f1f6 tempest-GroupSnapshotsTest-789445324 None] snapshot_file for this snap is: volume-47e6f095-77f3-4e5b-9441-b42aedc012a2.483cf18e-2c70-4ec0-a32d-279be9328b35 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 11:51:26 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d7ad99-63c9-4945-ad69-c455bc642cd5]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:51:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2047b3cb-5ec7-4ea1-b920-d8e26dc5f1f6 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2.483cf18e-2c70-4ec0-a32d-279be9328b35 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2047b3cb-5ec7-4ea1-b920-d8e26dc5f1f6 tempest-GroupSnapshotsTest-789445324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2.483cf18e-2c70-4ec0-a32d-279be9328b35" returned: 0 in 0.545s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-2047b3cb-5ec7-4ea1-b920-d8e26dc5f1f6 tempest-GroupSnapshotsTest-789445324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47e6f095-77f3-4e5b-9441-b42aedc012a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:51:27 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ab2978-d3af-45f0-8eae-bf8598b339df]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:51:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2047b3cb-5ec7-4ea1-b920-d8e26dc5f1f6 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2047b3cb-5ec7-4ea1-b920-d8e26dc5f1f6 tempest-GroupSnapshotsTest-789445324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2" returned: 0 in 0.773s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2047b3cb-5ec7-4ea1-b920-d8e26dc5f1f6 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2.483cf18e-2c70-4ec0-a32d-279be9328b35 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:28 devstack quobyte-client[82616]: System call of process 94307 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:51:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2047b3cb-5ec7-4ea1-b920-d8e26dc5f1f6 tempest-GroupSnapshotsTest-789445324 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2.483cf18e-2c70-4ec0-a32d-279be9328b35" returned: 0 in 0.626s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2047b3cb-5ec7-4ea1-b920-d8e26dc5f1f6 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2.483cf18e-2c70-4ec0-a32d-279be9328b35 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2047b3cb-5ec7-4ea1-b920-d8e26dc5f1f6 tempest-GroupSnapshotsTest-789445324 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2.483cf18e-2c70-4ec0-a32d-279be9328b35" returned: 0 in 0.190s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:29 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2047b3cb-5ec7-4ea1-b920-d8e26dc5f1f6 tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-483cf18e-2c70-4ec0-a32d-279be9328b35" released by "_delete_snapshot" :: held 2.612s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:51:29 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2047b3cb-5ec7-4ea1-b920-d8e26dc5f1f6 tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-47e6f095-77f3-4e5b-9441-b42aedc012a2" released by "delete_snapshot" :: held 2.655s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:51:29 devstack cinder-volume[82594]: WARNING cinder.quota [None req-2047b3cb-5ec7-4ea1-b920-d8e26dc5f1f6 tempest-GroupSnapshotsTest-789445324 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-944090336 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-944090336, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:51:30 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-2047b3cb-5ec7-4ea1-b920-d8e26dc5f1f6 tempest-GroupSnapshotsTest-789445324 None] Created reservations ['f6e1aefb-f3eb-4001-b324-5d5f88821779', '39d78aa8-a9a0-4007-8cc7-f49a978e3b35', 'fc4d92a8-4cd4-4695-88ca-fedb49f5b843', 'f064cca1-c245-4c66-a22b-31ce11a120ad'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:51:30 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-2047b3cb-5ec7-4ea1-b920-d8e26dc5f1f6 tempest-GroupSnapshotsTest-789445324 None] group_snapshot 62ccf065-644c-483f-9dc5-f7752aff6a12: deleted successfully
Sep 10 11:51:31 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-ec116d84-93d8-4f82-8444-d60cc75de891 tempest-GroupSnapshotsTest-789445324 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:51:31 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ec116d84-93d8-4f82-8444-d60cc75de891 tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "cinder-quobyte-47e6f095-77f3-4e5b-9441-b42aedc012a2" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:51:31 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ec116d84-93d8-4f82-8444-d60cc75de891 tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-47e6f095-77f3-4e5b-9441-b42aedc012a2" acquired by "delete_volume" :: waited 0.041s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:51:31 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f55814-64f6-4ccb-813f-0d8846cd65f1]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:51:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ec116d84-93d8-4f82-8444-d60cc75de891 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ec116d84-93d8-4f82-8444-d60cc75de891 tempest-GroupSnapshotsTest-789445324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2" returned: 0 in 0.627s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ec116d84-93d8-4f82-8444-d60cc75de891 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ec116d84-93d8-4f82-8444-d60cc75de891 tempest-GroupSnapshotsTest-789445324 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-47e6f095-77f3-4e5b-9441-b42aedc012a2" returned: 0 in 0.150s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:32 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ec116d84-93d8-4f82-8444-d60cc75de891 tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-47e6f095-77f3-4e5b-9441-b42aedc012a2" released by "delete_volume" :: held 1.189s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:51:33 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-ec116d84-93d8-4f82-8444-d60cc75de891 tempest-GroupSnapshotsTest-789445324 None] Created reservations ['b8e30fec-57ca-42b9-94d4-47e552be7664'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:51:33 devstack cinder-volume[82594]: WARNING cinder.db.sqlalchemy.api [None req-ec116d84-93d8-4f82-8444-d60cc75de891 tempest-GroupSnapshotsTest-789445324 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-944090336']
Sep 10 11:51:33 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-ec116d84-93d8-4f82-8444-d60cc75de891 tempest-GroupSnapshotsTest-789445324 None] Created reservations ['2626be91-8545-44c4-a1d7-dbdb967c1b77', 'c0b7ba8e-56eb-408d-bae2-42386d734a12', '4c5d14fc-bfd3-4a0d-8d75-509cd06fd2c3', 'd52a6ed2-4b2f-431d-811a-1989db81436d'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:51:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ec116d84-93d8-4f82-8444-d60cc75de891 tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:51:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ec116d84-93d8-4f82-8444-d60cc75de891 tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:51:33 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ec116d84-93d8-4f82-8444-d60cc75de891 tempest-GroupSnapshotsTest-789445324 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:51:33 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ec116d84-93d8-4f82-8444-d60cc75de891 tempest-GroupSnapshotsTest-789445324 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:51:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ec116d84-93d8-4f82-8444-d60cc75de891 tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:51:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ec116d84-93d8-4f82-8444-d60cc75de891 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ec116d84-93d8-4f82-8444-d60cc75de891 tempest-GroupSnapshotsTest-789445324 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.165s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:34 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-ec116d84-93d8-4f82-8444-d60cc75de891 tempest-GroupSnapshotsTest-789445324 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:51:34 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-ec116d84-93d8-4f82-8444-d60cc75de891 tempest-GroupSnapshotsTest-789445324 None] Delete group completed successfully.
Sep 10 11:51:35 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-f5f0c881-6116-413b-ac9f-ed9eed4b9bbc tempest-GroupSnapshotsTest-789445324 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:51:35 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-f5f0c881-6116-413b-ac9f-ed9eed4b9bbc tempest-GroupSnapshotsTest-789445324 None] Group tempest-GroupSnapshotsTest-Group-1105554445: creating
Sep 10 11:51:35 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-f5f0c881-6116-413b-ac9f-ed9eed4b9bbc tempest-GroupSnapshotsTest-789445324 None] Group tempest-GroupSnapshotsTest-Group-1105554445: created successfully
Sep 10 11:51:35 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-f5f0c881-6116-413b-ac9f-ed9eed4b9bbc tempest-GroupSnapshotsTest-789445324 None] Create group completed successfully.
Sep 10 11:51:37 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:51:37 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:51:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Flow 'volume_create_manager' (44720b7d-6317-4f0e-9119-a232723f7ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:51:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98df77f7-886c-4fdd-81d2-081de5e15b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98df77f7-886c-4fdd-81d2-081de5e15b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1596131736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8205aed6-2cbe-4837-92b4-890a103c0881,host='devstack@QuobyteHD#QuobyteHD',id=b07b11c9-a0d8-4470-aad2-2eafacd349b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac38359325e74533ba6c6d5776059be0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:51:37Z,use_quota=True,user_id='354ff4aee9a84a0bbdf1b5a3720ed108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2864362-514b-41d2-bc51-323172d58526),volume_type_id=e2864362-514b-41d2-bc51-323172d58526)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a541390-a9f6-4ce8-8a7b-7ac117110ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a541390-a9f6-4ce8-8a7b-7ac117110ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c935f70-9736-478a-9c38-bcd18a58f6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c935f70-9736-478a-9c38-bcd18a58f6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b07b11c9-a0d8-4470-aad2-2eafacd349b6', 'volume_name': 'volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e682cf18-b417-4c33-838a-4726c8250713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e682cf18-b417-4c33-838a-4726c8250713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670b9380-2c1a-4d0f-a519-b5d93eaf55e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:37 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Volume b07b11c9-a0d8-4470-aad2-2eafacd349b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6', 'volume_size': 1}
Sep 10 11:51:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:51:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:51:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8205aed6-2cbe-4837-92b4-890a103c0881,created_at=2025-09-10T09:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1596131736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8205aed6-2cbe-4837-92b4-890a103c0881,host='devstack@QuobyteHD#QuobyteHD',id=b07b11c9-a0d8-4470-aad2-2eafacd349b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac38359325e74533ba6c6d5776059be0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:51:37Z,use_quota=True,user_id='354ff4aee9a84a0bbdf1b5a3720ed108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2864362-514b-41d2-bc51-323172d58526),volume_type_id=e2864362-514b-41d2-bc51-323172d58526)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:51:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Creating volume b07b11c9-a0d8-4470-aad2-2eafacd349b6 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:51:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:51:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:51:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:51:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:51:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:51:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:51:37 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:51:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:37 devstack quobyte-client[82616]: System call of process 94323 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:51:37 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=80, name=volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:51:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6 1073741824" returned: 0 in 0.511s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6" returned: 0 in 0.244s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:38 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] <== create_volume: return (864ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:51:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:51:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670b9380-2c1a-4d0f-a519-b5d93eaf55e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebfd70e0-c571-404b-b351-86eea3dcd7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:38 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Volume volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6 (b07b11c9-a0d8-4470-aad2-2eafacd349b6): created successfully
Sep 10 11:51:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebfd70e0-c571-404b-b351-86eea3dcd7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Flow 'volume_create_manager' (44720b7d-6317-4f0e-9119-a232723f7ba5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:51:38 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-6a31115c-23b3-42fc-bab0-499dd855c4a3 tempest-GroupSnapshotsTest-789445324 None] Created volume successfully.
Sep 10 11:51:40 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:51:40 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:51:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Flow 'volume_create_manager' (d55dc0eb-f50a-4ad8-b99e-6e18a15999ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:51:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc13945d-a3a4-472c-8c1f-270c96ccdce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc13945d-a3a4-472c-8c1f-270c96ccdce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1805070008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8205aed6-2cbe-4837-92b4-890a103c0881,host='devstack@QuobyteHD#QuobyteHD',id=773041e0-c99a-4422-822f-b351877d0d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac38359325e74533ba6c6d5776059be0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:51:40Z,use_quota=True,user_id='354ff4aee9a84a0bbdf1b5a3720ed108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2864362-514b-41d2-bc51-323172d58526),volume_type_id=e2864362-514b-41d2-bc51-323172d58526)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da679362-a4c4-40f8-bd8c-1b9fadd18caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da679362-a4c4-40f8-bd8c-1b9fadd18caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb300471-cda3-4def-8c12-55f80dd6f656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb300471-cda3-4def-8c12-55f80dd6f656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '773041e0-c99a-4422-822f-b351877d0d32', 'volume_name': 'volume-773041e0-c99a-4422-822f-b351877d0d32', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3958ef-11cc-4795-ab73-9cdedba4d8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3958ef-11cc-4795-ab73-9cdedba4d8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35723ef7-a596-4020-a619-8d2d1dfe665d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:40 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Volume 773041e0-c99a-4422-822f-b351877d0d32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-773041e0-c99a-4422-822f-b351877d0d32', 'volume_size': 1}
Sep 10 11:51:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:51:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:51:40 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8205aed6-2cbe-4837-92b4-890a103c0881,created_at=2025-09-10T09:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1805070008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8205aed6-2cbe-4837-92b4-890a103c0881,host='devstack@QuobyteHD#QuobyteHD',id=773041e0-c99a-4422-822f-b351877d0d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac38359325e74533ba6c6d5776059be0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:51:40Z,use_quota=True,user_id='354ff4aee9a84a0bbdf1b5a3720ed108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2864362-514b-41d2-bc51-323172d58526),volume_type_id=e2864362-514b-41d2-bc51-323172d58526)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:51:40 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Creating volume 773041e0-c99a-4422-822f-b351877d0d32 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:51:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:51:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:51:40 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:51:40 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:51:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:51:40 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:51:40 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:51:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:41 devstack quobyte-client[82616]: System call of process 94329 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:51:41 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=81, name=volume-773041e0-c99a-4422-822f-b351877d0d32, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:51:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32 1073741824" returned: 0 in 0.532s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32" returned: 0 in 0.201s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] <== create_volume: return (859ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:51:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:51:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35723ef7-a596-4020-a619-8d2d1dfe665d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-773041e0-c99a-4422-822f-b351877d0d32', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d46c21-e0ff-4528-9292-03bc4bd8e445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:42 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Volume volume-773041e0-c99a-4422-822f-b351877d0d32 (773041e0-c99a-4422-822f-b351877d0d32): created successfully
Sep 10 11:51:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d46c21-e0ff-4528-9292-03bc4bd8e445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Flow 'volume_create_manager' (d55dc0eb-f50a-4ad8-b99e-6e18a15999ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:51:42 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-9b8def57-c57e-4fa5-87b5-b2c616e2d8d9 tempest-GroupSnapshotsTest-789445324 None] Created volume successfully.
Sep 10 11:51:43 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-944b2d57-8b49-4146-92cd-db89da3fe5ab tempest-GroupSnapshotsTest-789445324 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:51:43 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-944b2d57-8b49-4146-92cd-db89da3fe5ab tempest-GroupSnapshotsTest-789445324 None] Update group completed successfully.
Sep 10 11:51:44 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-0b5ed751-7128-436d-a0a3-c6902ac6d6cc tempest-GroupSnapshotsTest-789445324 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:51:44 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-0b5ed751-7128-436d-a0a3-c6902ac6d6cc tempest-GroupSnapshotsTest-789445324 None] Update group completed successfully.
Sep 10 11:51:45 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-148683ae-6dc5-4bac-a6f9-48debe6ffe4c tempest-GroupSnapshotsTest-789445324 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:51:45 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:51:45 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:51:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Flow 'volume_create_manager' (0dda4cb7-9b3e-4157-b948-5f412cce2b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:51:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b130ba55-1d90-472a-bdee-6ea1b2f83600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b130ba55-1d90-472a-bdee-6ea1b2f83600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2143022985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bec92ae-9fe3-4756-84a6-4a50f198f2b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='047c234fcaf6483eabefc11f15284cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:51:46Z,use_quota=True,user_id='121a678984604cb3a0a6126ecf4ed946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc533828-abbc-43ef-b2ff-88d63f06226a),volume_type_id=cc533828-abbc-43ef-b2ff-88d63f06226a)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (550fbefe-6cc2-4168-9ef0-706a3b127b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (550fbefe-6cc2-4168-9ef0-706a3b127b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746904cb-05c7-4f5c-b995-ba5b1459f654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746904cb-05c7-4f5c-b995-ba5b1459f654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bec92ae-9fe3-4756-84a6-4a50f198f2b1', 'volume_name': 'volume-4bec92ae-9fe3-4756-84a6-4a50f198f2b1', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46bf4707-8d99-41b7-8a98-436371861c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46bf4707-8d99-41b7-8a98-436371861c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d66aec-539c-43f0-9c58-413530edc56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:45 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Volume 4bec92ae-9fe3-4756-84a6-4a50f198f2b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bec92ae-9fe3-4756-84a6-4a50f198f2b1', 'volume_size': 1}
Sep 10 11:51:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:51:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:51:45 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2143022985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bec92ae-9fe3-4756-84a6-4a50f198f2b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='047c234fcaf6483eabefc11f15284cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:51:46Z,use_quota=True,user_id='121a678984604cb3a0a6126ecf4ed946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc533828-abbc-43ef-b2ff-88d63f06226a),volume_type_id=cc533828-abbc-43ef-b2ff-88d63f06226a)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:51:45 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Creating volume 4bec92ae-9fe3-4756-84a6-4a50f198f2b1 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:51:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:51:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:51:45 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:51:45 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:51:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:51:45 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:51:45 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:51:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4bec92ae-9fe3-4756-84a6-4a50f198f2b1 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:45 devstack quobyte-client[82616]: System call of process 94334 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:51:46 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=82, name=volume-4bec92ae-9fe3-4756-84a6-4a50f198f2b1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:51:46 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-148683ae-6dc5-4bac-a6f9-48debe6ffe4c tempest-GroupSnapshotsTest-789445324 None] Update group completed successfully.
Sep 10 11:51:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4bec92ae-9fe3-4756-84a6-4a50f198f2b1 1073741824" returned: 0 in 0.603s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4bec92ae-9fe3-4756-84a6-4a50f198f2b1 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:46 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:51:46 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:51:46 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Flow 'volume_create_manager' (acdbf1e1-c476-47de-833d-d3a6c679af32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:51:46 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a25c0527-c270-47aa-9a26-1f8deba9631d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4bec92ae-9fe3-4756-84a6-4a50f198f2b1" returned: 0 in 0.398s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:46 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] <== create_volume: return (1021ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:51:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:51:46 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a25c0527-c270-47aa-9a26-1f8deba9631d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1047645868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25af4e57-f266-481e-aba7-325fa60c9c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='047c234fcaf6483eabefc11f15284cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:51:46Z,use_quota=True,user_id='121a678984604cb3a0a6126ecf4ed946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(901abd52-0bf4-4670-98f4-10d4cb28fada),volume_type_id=901abd52-0bf4-4670-98f4-10d4cb28fada)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:46 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (750d3452-68e3-477d-8d3e-ef87acba6ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:46 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (750d3452-68e3-477d-8d3e-ef87acba6ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:47 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31cc63e8-48df-49c6-b0c5-a8306a5dad30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:47 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31cc63e8-48df-49c6-b0c5-a8306a5dad30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25af4e57-f266-481e-aba7-325fa60c9c89', 'volume_name': 'volume-25af4e57-f266-481e-aba7-325fa60c9c89', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:47 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b55afa3-b982-4c7b-aac6-3e89b5edbbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:47 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b55afa3-b982-4c7b-aac6-3e89b5edbbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:47 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa82f0b7-cbef-4ee3-8759-eda541b5b31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:47 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Volume 25af4e57-f266-481e-aba7-325fa60c9c89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25af4e57-f266-481e-aba7-325fa60c9c89', 'volume_size': 1}
Sep 10 11:51:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:51:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:51:47 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1047645868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25af4e57-f266-481e-aba7-325fa60c9c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='047c234fcaf6483eabefc11f15284cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:51:46Z,use_quota=True,user_id='121a678984604cb3a0a6126ecf4ed946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(901abd52-0bf4-4670-98f4-10d4cb28fada),volume_type_id=901abd52-0bf4-4670-98f4-10d4cb28fada)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:51:47 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Creating volume 25af4e57-f266-481e-aba7-325fa60c9c89 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:51:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:51:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:51:47 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:51:47 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:51:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:51:47 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:51:47 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:51:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-25af4e57-f266-481e-aba7-325fa60c9c89 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:47 devstack quobyte-client[82616]: System call of process 94338 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:51:47 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=83, name=volume-25af4e57-f266-481e-aba7-325fa60c9c89, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:51:47 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d66aec-539c-43f0-9c58-413530edc56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bec92ae-9fe3-4756-84a6-4a50f198f2b1', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:47 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9514db11-9795-43eb-ad08-2e5bcb8dc1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:47 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Volume volume-4bec92ae-9fe3-4756-84a6-4a50f198f2b1 (4bec92ae-9fe3-4756-84a6-4a50f198f2b1): created successfully
Sep 10 11:51:47 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9514db11-9795-43eb-ad08-2e5bcb8dc1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:47 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Flow 'volume_create_manager' (0dda4cb7-9b3e-4157-b948-5f412cce2b5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:51:47 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-7517d138-51f1-4f5b-a4d1-999c08d8d1b8 tempest-GroupSnapshotsTest-789445324 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:51:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-25af4e57-f266-481e-aba7-325fa60c9c89 1073741824" returned: 0 in 0.642s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-25af4e57-f266-481e-aba7-325fa60c9c89 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:48 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-47982aff-9ac0-4f26-b872-149ca40823e5 tempest-TestInstancesWithCinderVolumes-278728036 None] Created volume successfully.
Sep 10 11:51:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-25af4e57-f266-481e-aba7-325fa60c9c89" returned: 0 in 0.370s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:48 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] <== create_volume: return (1032ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:51:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:51:48 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:51:48 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:51:48 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Flow 'volume_create_manager' (fd7f2431-4b2d-4746-85e7-fcd89781b191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:51:48 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87223da2-3a56-40c5-8b62-1ef0dd03fd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:48 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa82f0b7-cbef-4ee3-8759-eda541b5b31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25af4e57-f266-481e-aba7-325fa60c9c89', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:48 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec82fd1e-f8df-4ddf-8d57-c69a424d874d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:48 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87223da2-3a56-40c5-8b62-1ef0dd03fd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2066068750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b59109f-8a4d-42a5-8d27-796254f4bc4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='047c234fcaf6483eabefc11f15284cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:51:48Z,use_quota=True,user_id='121a678984604cb3a0a6126ecf4ed946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(396c248e-edae-4050-b421-65bed28d823c),volume_type_id=396c248e-edae-4050-b421-65bed28d823c)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:48 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6477fc0-aa34-46aa-af89-3f730faa00a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:48 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6477fc0-aa34-46aa-af89-3f730faa00a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:48 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ffa8bd-aca2-4065-9d6c-b41268e7d39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:48 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-7517d138-51f1-4f5b-a4d1-999c08d8d1b8 tempest-GroupSnapshotsTest-789445324 None] Update group completed successfully.
Sep 10 11:51:48 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Volume volume-25af4e57-f266-481e-aba7-325fa60c9c89 (25af4e57-f266-481e-aba7-325fa60c9c89): created successfully
Sep 10 11:51:48 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec82fd1e-f8df-4ddf-8d57-c69a424d874d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:48 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Flow 'volume_create_manager' (acdbf1e1-c476-47de-833d-d3a6c679af32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:51:48 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-abcb85f2-50ab-46a3-a3db-c14183ba52a8 tempest-TestInstancesWithCinderVolumes-278728036 None] Created volume successfully.
Sep 10 11:51:48 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ffa8bd-aca2-4065-9d6c-b41268e7d39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5b59109f-8a4d-42a5-8d27-796254f4bc4e', 'volume_name': 'volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e', 'volume_size': 1, 'image_id': '8c520a41-acaf-434b-afe3-fa225074ddc8', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--677028209', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '047c234fcaf6483eabefc11f15284cb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c520a41-acaf-434b-afe3-fa225074ddc8', 'created_at': datetime.datetime(2025, 9, 10, 9, 51, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 9, 51, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c520a41-acaf-434b-afe3-fa225074ddc8/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4f477f6050>}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:48 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0b85c6-60f5-4155-a2ae-e6965842d7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:48 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0b85c6-60f5-4155-a2ae-e6965842d7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:51:48 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7135e96b-3b7b-4c96-93b2-0d61ac3c732d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:51:48 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Volume 5b59109f-8a4d-42a5-8d27-796254f4bc4e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e', 'volume_size': 1, 'image_id': '8c520a41-acaf-434b-afe3-fa225074ddc8', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--677028209', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '047c234fcaf6483eabefc11f15284cb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c520a41-acaf-434b-afe3-fa225074ddc8', 'created_at': datetime.datetime(2025, 9, 10, 9, 51, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 9, 51, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c520a41-acaf-434b-afe3-fa225074ddc8/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4f477f6050>}
Sep 10 11:51:48 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Cloning 5b59109f-8a4d-42a5-8d27-796254f4bc4e from image 8c520a41-acaf-434b-afe3-fa225074ddc8  at location (None, None). {{(pid=82594) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 11:51:49 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] GroupSnapshot 759dc724-8398-492a-a612-a117a77683c5: creating.
Sep 10 11:51:49 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:51:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] Group snapshot 759dc724-8398-492a-a612-a117a77683c5: creating. {{(pid=82594) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 10 11:51:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:51:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:51:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] Creating offline snapshot 9b41a95b-f1a8-41ce-835c-bcfcb93e3e26 of volume b07b11c9-a0d8-4470-aad2-2eafacd349b6 {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 11:51:49 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d12160-903a-4852-bcfd-3e6f7869951c]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:51:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6" returned: 0 in 0.609s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6.9b41a95b-f1a8-41ce-835c-bcfcb93e3e26 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:50 devstack quobyte-client[82616]: System call of process 94378 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:51:50 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=84, name=volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6.9b41a95b-f1a8-41ce-835c-bcfcb93e3e26, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:51:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6.9b41a95b-f1a8-41ce-835c-bcfcb93e3e26 1G" returned: 0 in 0.388s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6 -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6.9b41a95b-f1a8-41ce-835c-bcfcb93e3e26 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] CMD "qemu-img rebase -u -b volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6 -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6.9b41a95b-f1a8-41ce-835c-bcfcb93e3e26" returned: 0 in 0.191s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:50 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6.9b41a95b-f1a8-41ce-835c-bcfcb93e3e26 is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:51:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6.9b41a95b-f1a8-41ce-835c-bcfcb93e3e26 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6.9b41a95b-f1a8-41ce-835c-bcfcb93e3e26" returned: 0 in 0.123s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:50 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6 -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 11:51:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6.9b41a95b-f1a8-41ce-835c-bcfcb93e3e26 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6.9b41a95b-f1a8-41ce-835c-bcfcb93e3e26" returned: 0 in 0.131s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6.info" returned: 0 in 0.106s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6.info is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:51:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6.info" returned: 0 in 0.103s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.948s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:51:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:51:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:51:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] Creating offline snapshot d4cdefa3-648f-4627-9c98-4565081bb034 of volume 773041e0-c99a-4422-822f-b351877d0d32 {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 11:51:51 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04fdf5f-60d1-42be-8ba4-bfe2b14c8bf3]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:51:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32" returned: 0 in 0.472s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32.d4cdefa3-648f-4627-9c98-4565081bb034 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:52 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=86, name=volume-773041e0-c99a-4422-822f-b351877d0d32.d4cdefa3-648f-4627-9c98-4565081bb034, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:51:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32.d4cdefa3-648f-4627-9c98-4565081bb034 1G" returned: 0 in 0.306s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): qemu-img rebase -u -b volume-773041e0-c99a-4422-822f-b351877d0d32 -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32.d4cdefa3-648f-4627-9c98-4565081bb034 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] CMD "qemu-img rebase -u -b volume-773041e0-c99a-4422-822f-b351877d0d32 -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32.d4cdefa3-648f-4627-9c98-4565081bb034" returned: 0 in 0.212s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:52 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32.d4cdefa3-648f-4627-9c98-4565081bb034 is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:51:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32.d4cdefa3-648f-4627-9c98-4565081bb034 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32.d4cdefa3-648f-4627-9c98-4565081bb034" returned: 0 in 0.111s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:52 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32 -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 11:51:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32.d4cdefa3-648f-4627-9c98-4565081bb034 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32.d4cdefa3-648f-4627-9c98-4565081bb034" returned: 0 in 0.119s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32.info" returned: 0 in 0.137s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:53 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32.info is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:51:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32.info" returned: 0 in 0.104s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.956s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:51:53 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-efcf0647-054b-4533-8458-ffe34fc42361 tempest-GroupSnapshotsTest-789445324 None] group_snapshot 759dc724-8398-492a-a612-a117a77683c5: created successfully
Sep 10 11:51:53 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8c520a41-acaf-434b-afe3-fa225074ddc8_x7icxt4udevstack@QuobyteHD, size 20.69 MB, duration 5.42 sec {{(pid=82594) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 11:51:53 devstack cinder-volume[82594]: INFO cinder.image.image_utils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Image download 20.69 MB at 3.82 MB/s
Sep 10 11:51:54 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[255ea611-866b-488a-9713-38e28cd3d3bc]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:51:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c520a41-acaf-434b-afe3-fa225074ddc8_x7icxt4udevstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:54 devstack sudo[94403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c520a41-acaf-434b-afe3-fa225074ddc8_x7icxt4udevstack@QuobyteHD
Sep 10 11:51:54 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:51:55 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] group_snapshot 759dc724-8398-492a-a612-a117a77683c5: deleting
Sep 10 11:51:55 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:51:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] group_snapshot 759dc724-8398-492a-a612-a117a77683c5: deleting {{(pid=82594) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 10 11:51:55 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "cinder-quobyte-b07b11c9-a0d8-4470-aad2-2eafacd349b6" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:51:55 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-b07b11c9-a0d8-4470-aad2-2eafacd349b6" acquired by "delete_snapshot" :: waited 0.071s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:51:55 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "cinder-quobyte-9b41a95b-f1a8-41ce-835c-bcfcb93e3e26" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:51:55 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-9b41a95b-f1a8-41ce-835c-bcfcb93e3e26" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:51:55 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Deleting offline snapshot 9b41a95b-f1a8-41ce-835c-bcfcb93e3e26 of volume b07b11c9-a0d8-4470-aad2-2eafacd349b6 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 11:51:55 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] snapshot_file for this snap is: volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6.9b41a95b-f1a8-41ce-835c-bcfcb93e3e26 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 11:51:55 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfe4627-c6dc-49ca-ab28-73cb5def8079]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:51:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6.9b41a95b-f1a8-41ce-835c-bcfcb93e3e26 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6.9b41a95b-f1a8-41ce-835c-bcfcb93e3e26" returned: 0 in 0.471s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:55 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:51:56 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90da42b-43ed-4a31-b6d2-83b8a2c23a74]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:51:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:56 devstack quobyte-client[82616]: System call of process 94411 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:51:56 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root
Sep 10 11:51:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c520a41-acaf-434b-afe3-fa225074ddc8_x7icxt4udevstack@QuobyteHD" returned: 0 in 2.623s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:56 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Temporary image 8c520a41-acaf-434b-afe3-fa225074ddc8 is fetched for user 121a678984604cb3a0a6126ecf4ed946. {{(pid=82594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 11:51:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6" returned: 0 in 0.834s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6.9b41a95b-f1a8-41ce-835c-bcfcb93e3e26 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6.9b41a95b-f1a8-41ce-835c-bcfcb93e3e26" returned: 0 in 0.387s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6.9b41a95b-f1a8-41ce-835c-bcfcb93e3e26 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:57 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac710f8-0cca-4534-aba7-6ea0785e9bf6]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:51:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c520a41-acaf-434b-afe3-fa225074ddc8_x7icxt4udevstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6.9b41a95b-f1a8-41ce-835c-bcfcb93e3e26" returned: 0 in 0.218s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:57 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-9b41a95b-f1a8-41ce-835c-bcfcb93e3e26" released by "_delete_snapshot" :: held 2.274s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:51:57 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-b07b11c9-a0d8-4470-aad2-2eafacd349b6" released by "delete_snapshot" :: held 2.301s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:51:57 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "cinder-quobyte-773041e0-c99a-4422-822f-b351877d0d32" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:51:57 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-773041e0-c99a-4422-822f-b351877d0d32" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:51:57 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "cinder-quobyte-d4cdefa3-648f-4627-9c98-4565081bb034" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:51:57 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-d4cdefa3-648f-4627-9c98-4565081bb034" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:51:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Deleting offline snapshot d4cdefa3-648f-4627-9c98-4565081bb034 of volume 773041e0-c99a-4422-822f-b351877d0d32 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 11:51:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] snapshot_file for this snap is: volume-773041e0-c99a-4422-822f-b351877d0d32.d4cdefa3-648f-4627-9c98-4565081bb034 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 11:51:57 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f668ce31-b7d8-4676-815d-ea68f937c7a3]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:51:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32.d4cdefa3-648f-4627-9c98-4565081bb034 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:58 devstack sudo[94418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c520a41-acaf-434b-afe3-fa225074ddc8_x7icxt4udevstack@QuobyteHD
Sep 10 11:51:58 devstack sudo[94418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 11:51:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32.d4cdefa3-648f-4627-9c98-4565081bb034" returned: 0 in 0.432s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:58 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-773041e0-c99a-4422-822f-b351877d0d32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:51:58 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f286aa3-ebc1-483d-942d-233f53c31fde]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:51:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32" returned: 0 in 0.536s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32.d4cdefa3-648f-4627-9c98-4565081bb034 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32.d4cdefa3-648f-4627-9c98-4565081bb034" returned: 0 in 0.218s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32.d4cdefa3-648f-4627-9c98-4565081bb034 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:51:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32.d4cdefa3-648f-4627-9c98-4565081bb034" returned: 0 in 0.327s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:51:59 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-d4cdefa3-648f-4627-9c98-4565081bb034" released by "_delete_snapshot" :: held 1.977s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:51:59 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-773041e0-c99a-4422-822f-b351877d0d32" released by "delete_snapshot" :: held 2.017s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:52:00 devstack sudo[94418]: pam_unix(sudo:session): session closed for user root
Sep 10 11:52:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c520a41-acaf-434b-afe3-fa225074ddc8_x7icxt4udevstack@QuobyteHD" returned: 0 in 2.693s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:52:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:52:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2066068750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b59109f-8a4d-42a5-8d27-796254f4bc4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='047c234fcaf6483eabefc11f15284cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:51:48Z,use_quota=True,user_id='121a678984604cb3a0a6126ecf4ed946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(396c248e-edae-4050-b421-65bed28d823c),volume_type_id=396c248e-edae-4050-b421-65bed28d823c)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:52:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Creating volume 5b59109f-8a4d-42a5-8d27-796254f4bc4e {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:52:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:52:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:52:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:52:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:52:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:52:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:52:00 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:52:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:00 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=88, name=volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:52:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e 1073741824" returned: 0 in 0.516s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e" returned: 0 in 0.264s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] <== create_volume: return (835ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:52:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:52:01 devstack cinder-volume[82594]: WARNING cinder.quota [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-383566607 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-383566607, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:52:01 devstack cinder-volume[82594]: WARNING cinder.quota [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-383566607 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-383566607, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:52:01 devstack cinder-volume[82594]: DEBUG cinder.volume.volume_utils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Attempting download of 8c520a41-acaf-434b-afe3-fa225074ddc8 ((None, None)) to volume 5b59109f-8a4d-42a5-8d27-796254f4bc4e. {{(pid=82594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 11:52:01 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Created reservations ['ef601567-f6b6-4c69-bc24-f066470aa90f', '97e6889a-87c9-410d-a1cc-7be32ab1e55e', '9862cae6-c5f2-45d2-888c-fad97a1ad750', 'b8c2595a-4b98-4fcf-a0fb-104499c2b380'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:52:01 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e12502-6df2-43ad-b087-a9fe1c098871]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:52:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c520a41-acaf-434b-afe3-fa225074ddc8_kta3n0za {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c520a41-acaf-434b-afe3-fa225074ddc8_kta3n0za" returned: 0 in 0.568s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c520a41-acaf-434b-afe3-fa225074ddc8_kta3n0za {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:02 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] Created reservations ['ee3640df-c333-456f-9e29-50100b624569', '65b2ba9c-1be0-4ef2-ad67-2f2b49e8d703', '625f96e4-60f8-46bb-a90c-e658142c851e', 'fab690b4-3d9d-4a2a-990b-ee8d5e88e9b4'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:52:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c520a41-acaf-434b-afe3-fa225074ddc8_kta3n0za" returned: 1 in 0.526s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c520a41-acaf-434b-afe3-fa225074ddc8_kta3n0za' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 11:52:02 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65021d3-7b03-4552-88c7-536c4a1dab72]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:52:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c520a41-acaf-434b-afe3-fa225074ddc8_x7icxt4udevstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:02 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-a1dcfa6c-f1ba-4b47-a8b5-e039253bf29f tempest-GroupSnapshotsTest-789445324 None] group_snapshot 759dc724-8398-492a-a612-a117a77683c5: deleted successfully
Sep 10 11:52:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c520a41-acaf-434b-afe3-fa225074ddc8_x7icxt4udevstack@QuobyteHD" returned: 0 in 0.446s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:02 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] 8c520a41-acaf-434b-afe3-fa225074ddc8 was qcow2, converting to raw {{(pid=82594) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 11:52:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c520a41-acaf-434b-afe3-fa225074ddc8_x7icxt4udevstack@QuobyteHD /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:03 devstack quobyte-client[82616]: System call of process 94447 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:52:03 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=88, name=volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:52:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c520a41-acaf-434b-afe3-fa225074ddc8_x7icxt4udevstack@QuobyteHD /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e" returned: 0 in 1.209s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:04 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8c520a41-acaf-434b-afe3-fa225074ddc8_x7icxt4udevstack@QuobyteHD, size 112.00 MB, duration 1.24 sec, destination /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e {{(pid=82594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 11:52:04 devstack cinder-volume[82594]: INFO cinder.image.image_utils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Converted 112.00 MB image at 90.39 MB/s
Sep 10 11:52:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e 1G" returned: 0 in 0.399s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:04 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:52:04 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "cinder-quobyte-773041e0-c99a-4422-822f-b351877d0d32" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:52:04 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e547ab-2f5d-4551-a1a9-fac51371994e]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:52:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:04 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-773041e0-c99a-4422-822f-b351877d0d32" acquired by "delete_volume" :: waited 0.228s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:52:04 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9abdf8-197c-4aa1-87a0-ceb051437fad]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:52:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e" returned: 0 in 0.469s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32" returned: 0 in 0.595s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-773041e0-c99a-4422-822f-b351877d0d32" returned: 0 in 0.103s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e" returned: 1 in 0.576s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 11:52:05 devstack cinder-volume[82594]: DEBUG cinder.volume.volume_utils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Downloaded image 8c520a41-acaf-434b-afe3-fa225074ddc8 ((None, None)) to volume 5b59109f-8a4d-42a5-8d27-796254f4bc4e successfully. {{(pid=82594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 11:52:05 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Temporary image 8c520a41-acaf-434b-afe3-fa225074ddc8 for user 121a678984604cb3a0a6126ecf4ed946 is deleted. {{(pid=82594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 11:52:05 devstack cinder-volume[82594]: DEBUG cinder.volume.volume_utils [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Marking volume 5b59109f-8a4d-42a5-8d27-796254f4bc4e as bootable. {{(pid=82594) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 11:52:05 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-773041e0-c99a-4422-822f-b351877d0d32" released by "delete_volume" :: held 1.050s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:52:05 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "cinder-quobyte-b07b11c9-a0d8-4470-aad2-2eafacd349b6" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:52:06 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Copying metadata from image 8c520a41-acaf-434b-afe3-fa225074ddc8 to 5b59109f-8a4d-42a5-8d27-796254f4bc4e. {{(pid=82594) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 11:52:06 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Creating volume glance metadata for volume 5b59109f-8a4d-42a5-8d27-796254f4bc4e backed by image 8c520a41-acaf-434b-afe3-fa225074ddc8 with: {'image_id': '8c520a41-acaf-434b-afe3-fa225074ddc8', 'image_name': 'tempest-scenario-img--677028209', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82594) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 11:52:06 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-b07b11c9-a0d8-4470-aad2-2eafacd349b6" acquired by "delete_volume" :: waited 0.166s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:52:06 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84292e9-61b2-4972-99ba-94ae1bc62ca8]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:52:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7135e96b-3b7b-4c96-93b2-0d61ac3c732d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e', 'volume_size': 1, 'image_id': '8c520a41-acaf-434b-afe3-fa225074ddc8', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--677028209', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '047c234fcaf6483eabefc11f15284cb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c520a41-acaf-434b-afe3-fa225074ddc8', 'created_at': datetime.datetime(2025, 9, 10, 9, 51, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 9, 51, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c520a41-acaf-434b-afe3-fa225074ddc8/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4f477f6050>}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:52:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a12c3c4-72ab-425c-9450-55ee18f57012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:52:06 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Volume volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e (5b59109f-8a4d-42a5-8d27-796254f4bc4e): created successfully
Sep 10 11:52:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a12c3c4-72ab-425c-9450-55ee18f57012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:52:06 devstack quobyte-client[82616]: System call of process 94465 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:52:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Flow 'volume_create_manager' (fd7f2431-4b2d-4746-85e7-fcd89781b191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:52:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6" returned: 0 in 0.594s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:06 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-200ffb0f-1878-4e69-8e65-1d94e207a46b tempest-TestInstancesWithCinderVolumes-278728036 None] Created volume successfully.
Sep 10 11:52:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b07b11c9-a0d8-4470-aad2-2eafacd349b6" returned: 0 in 0.230s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:07 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-b07b11c9-a0d8-4470-aad2-2eafacd349b6" released by "delete_volume" :: held 0.988s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:52:07 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] Created reservations ['a0e42ffb-e346-488b-a649-1d1179e752b7'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:52:07 devstack cinder-volume[82594]: WARNING cinder.quota [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-383566607 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-383566607, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:52:07 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] Created reservations ['647e2c53-661c-4e09-a5b9-7fb6e938a1c1', '8184690c-bd82-4c8d-ba43-19d2ada44e84', 'c8295bcb-2235-4671-b0b8-c9f35ff76565', 'd2aa4509-8a3f-43f1-9e2d-f719d8701b1e'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:52:07 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] Created reservations ['5ccc18cf-5fd8-4d0a-8dd4-247034e04f3f', '4e38a554-7a03-4293-921a-7923dc7d175a', '604e7887-8041-45c2-acda-cf5894e7c7a7', '18053997-eca1-4cf2-915c-f63d8a59478a'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:52:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:52:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:52:07 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:52:07 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:52:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:52:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.111s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:08 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:52:08 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-47600ad3-a6c6-42f1-9af4-8627a89ac351 tempest-GroupSnapshotsTest-789445324 None] Delete group completed successfully.
Sep 10 11:52:09 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-753176b9-3453-4ea5-8854-fbd413ee5f8f tempest-GroupSnapshotsTest-789445324 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:52:09 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-753176b9-3453-4ea5-8854-fbd413ee5f8f tempest-GroupSnapshotsTest-789445324 None] Group tempest-GroupSnapshotsTest-Group-862677141: creating
Sep 10 11:52:09 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-753176b9-3453-4ea5-8854-fbd413ee5f8f tempest-GroupSnapshotsTest-789445324 None] Group tempest-GroupSnapshotsTest-Group-862677141: created successfully
Sep 10 11:52:09 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-753176b9-3453-4ea5-8854-fbd413ee5f8f tempest-GroupSnapshotsTest-789445324 None] Create group completed successfully.
Sep 10 11:52:11 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:52:11 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:52:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Flow 'volume_create_manager' (5d1f1ea8-c110-4514-83d3-ea5b1a69f4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:52:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e7dff9-aa7a-42a7-b1de-963bf5ac63bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:52:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e7dff9-aa7a-42a7-b1de-963bf5ac63bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-24383096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f040fa1a-61bb-4d87-a48f-7e78444108d3,host='devstack@QuobyteHD#QuobyteHD',id=e78ca21e-cf8e-422c-9177-3b82a6175797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac38359325e74533ba6c6d5776059be0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:52:11Z,use_quota=True,user_id='354ff4aee9a84a0bbdf1b5a3720ed108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(abe0ad3a-695e-4eca-b9ab-01c36fab5881),volume_type_id=abe0ad3a-695e-4eca-b9ab-01c36fab5881)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:52:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd3d8b4-6b4b-410d-b846-38853bba3cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:52:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd3d8b4-6b4b-410d-b846-38853bba3cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:52:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afcc5edc-7c07-4598-9ffe-cc4b988080a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:52:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afcc5edc-7c07-4598-9ffe-cc4b988080a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e78ca21e-cf8e-422c-9177-3b82a6175797', 'volume_name': 'volume-e78ca21e-cf8e-422c-9177-3b82a6175797', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:52:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e88b34-ba54-418a-bf2d-e6d95b947967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:52:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e88b34-ba54-418a-bf2d-e6d95b947967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:52:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf268c8-acbe-4267-b368-e88d0855a5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:52:11 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Volume e78ca21e-cf8e-422c-9177-3b82a6175797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e78ca21e-cf8e-422c-9177-3b82a6175797', 'volume_size': 1}
Sep 10 11:52:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:52:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:52:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f040fa1a-61bb-4d87-a48f-7e78444108d3,created_at=2025-09-10T09:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-24383096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f040fa1a-61bb-4d87-a48f-7e78444108d3,host='devstack@QuobyteHD#QuobyteHD',id=e78ca21e-cf8e-422c-9177-3b82a6175797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac38359325e74533ba6c6d5776059be0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:52:11Z,use_quota=True,user_id='354ff4aee9a84a0bbdf1b5a3720ed108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(abe0ad3a-695e-4eca-b9ab-01c36fab5881),volume_type_id=abe0ad3a-695e-4eca-b9ab-01c36fab5881)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:52:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Creating volume e78ca21e-cf8e-422c-9177-3b82a6175797 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:52:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:52:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:52:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:52:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:52:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:52:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:52:11 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:52:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:11 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=89, name=volume-e78ca21e-cf8e-422c-9177-3b82a6175797, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:52:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797 1073741824" returned: 0 in 0.381s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797" returned: 0 in 0.142s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:12 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] <== create_volume: return (628ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:52:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.642s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:52:12 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf268c8-acbe-4267-b368-e88d0855a5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e78ca21e-cf8e-422c-9177-3b82a6175797', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:52:12 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ab87ef-a2ea-40a2-a26e-60419e323ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:52:12 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Volume volume-e78ca21e-cf8e-422c-9177-3b82a6175797 (e78ca21e-cf8e-422c-9177-3b82a6175797): created successfully
Sep 10 11:52:12 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ab87ef-a2ea-40a2-a26e-60419e323ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:52:12 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Flow 'volume_create_manager' (5d1f1ea8-c110-4514-83d3-ea5b1a69f4fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:52:12 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-cc411683-2908-447d-8ba1-10b271048e0e tempest-GroupSnapshotsTest-789445324 None] Created volume successfully.
Sep 10 11:52:14 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-fb1a3392-26c0-4609-8ad3-cf5933f6d925 tempest-GroupSnapshotsTest-789445324 None] GroupSnapshot 0c5151f4-a464-4eff-910a-cef26d4f766f: creating.
Sep 10 11:52:14 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-fb1a3392-26c0-4609-8ad3-cf5933f6d925 tempest-GroupSnapshotsTest-789445324 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:52:14 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fb1a3392-26c0-4609-8ad3-cf5933f6d925 tempest-GroupSnapshotsTest-789445324 None] Group snapshot 0c5151f4-a464-4eff-910a-cef26d4f766f: creating. {{(pid=82594) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 10 11:52:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fb1a3392-26c0-4609-8ad3-cf5933f6d925 tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:52:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fb1a3392-26c0-4609-8ad3-cf5933f6d925 tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:52:14 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-fb1a3392-26c0-4609-8ad3-cf5933f6d925 tempest-GroupSnapshotsTest-789445324 None] Creating offline snapshot 214d64a8-4b36-47e0-9c2c-b55c983dbc0b of volume e78ca21e-cf8e-422c-9177-3b82a6175797 {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 11:52:14 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f19ff4-e30d-414f-a143-37111ef8d5ef]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:52:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb1a3392-26c0-4609-8ad3-cf5933f6d925 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:14 devstack quobyte-client[82616]: System call of process 94475 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:52:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb1a3392-26c0-4609-8ad3-cf5933f6d925 tempest-GroupSnapshotsTest-789445324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797" returned: 0 in 0.527s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb1a3392-26c0-4609-8ad3-cf5933f6d925 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797.214d64a8-4b36-47e0-9c2c-b55c983dbc0b 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:15 devstack quobyte-client[82616]: System call of process 94478 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:52:15 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=90, name=volume-e78ca21e-cf8e-422c-9177-3b82a6175797.214d64a8-4b36-47e0-9c2c-b55c983dbc0b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:52:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb1a3392-26c0-4609-8ad3-cf5933f6d925 tempest-GroupSnapshotsTest-789445324 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797.214d64a8-4b36-47e0-9c2c-b55c983dbc0b 1G" returned: 0 in 0.398s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb1a3392-26c0-4609-8ad3-cf5933f6d925 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e78ca21e-cf8e-422c-9177-3b82a6175797 -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797.214d64a8-4b36-47e0-9c2c-b55c983dbc0b {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb1a3392-26c0-4609-8ad3-cf5933f6d925 tempest-GroupSnapshotsTest-789445324 None] CMD "qemu-img rebase -u -b volume-e78ca21e-cf8e-422c-9177-3b82a6175797 -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797.214d64a8-4b36-47e0-9c2c-b55c983dbc0b" returned: 0 in 0.245s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:15 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-fb1a3392-26c0-4609-8ad3-cf5933f6d925 tempest-GroupSnapshotsTest-789445324 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797.214d64a8-4b36-47e0-9c2c-b55c983dbc0b is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:52:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb1a3392-26c0-4609-8ad3-cf5933f6d925 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797.214d64a8-4b36-47e0-9c2c-b55c983dbc0b {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb1a3392-26c0-4609-8ad3-cf5933f6d925 tempest-GroupSnapshotsTest-789445324 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797.214d64a8-4b36-47e0-9c2c-b55c983dbc0b" returned: 0 in 0.152s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:16 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-fb1a3392-26c0-4609-8ad3-cf5933f6d925 tempest-GroupSnapshotsTest-789445324 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797 -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 11:52:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb1a3392-26c0-4609-8ad3-cf5933f6d925 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797.214d64a8-4b36-47e0-9c2c-b55c983dbc0b {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb1a3392-26c0-4609-8ad3-cf5933f6d925 tempest-GroupSnapshotsTest-789445324 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797.214d64a8-4b36-47e0-9c2c-b55c983dbc0b" returned: 0 in 0.148s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb1a3392-26c0-4609-8ad3-cf5933f6d925 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb1a3392-26c0-4609-8ad3-cf5933f6d925 tempest-GroupSnapshotsTest-789445324 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797.info" returned: 0 in 0.208s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:16 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-fb1a3392-26c0-4609-8ad3-cf5933f6d925 tempest-GroupSnapshotsTest-789445324 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797.info is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:52:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb1a3392-26c0-4609-8ad3-cf5933f6d925 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb1a3392-26c0-4609-8ad3-cf5933f6d925 tempest-GroupSnapshotsTest-789445324 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797.info" returned: 0 in 0.201s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fb1a3392-26c0-4609-8ad3-cf5933f6d925 tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.383s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:52:17 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-fb1a3392-26c0-4609-8ad3-cf5933f6d925 tempest-GroupSnapshotsTest-789445324 None] group_snapshot 0c5151f4-a464-4eff-910a-cef26d4f766f: created successfully
Sep 10 11:52:18 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-2f07d3df-49e7-41be-b0a3-7cd6f32404da tempest-GroupSnapshotsTest-789445324 None] group_snapshot 0c5151f4-a464-4eff-910a-cef26d4f766f: deleting
Sep 10 11:52:18 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-2f07d3df-49e7-41be-b0a3-7cd6f32404da tempest-GroupSnapshotsTest-789445324 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:52:18 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2f07d3df-49e7-41be-b0a3-7cd6f32404da tempest-GroupSnapshotsTest-789445324 None] group_snapshot 0c5151f4-a464-4eff-910a-cef26d4f766f: deleting {{(pid=82594) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 10 11:52:18 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2f07d3df-49e7-41be-b0a3-7cd6f32404da tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "cinder-quobyte-e78ca21e-cf8e-422c-9177-3b82a6175797" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:52:18 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2f07d3df-49e7-41be-b0a3-7cd6f32404da tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-e78ca21e-cf8e-422c-9177-3b82a6175797" acquired by "delete_snapshot" :: waited 0.136s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:52:18 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2f07d3df-49e7-41be-b0a3-7cd6f32404da tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "cinder-quobyte-214d64a8-4b36-47e0-9c2c-b55c983dbc0b" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:52:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-7e739f63-59e9-4bfe-a678-65ea1e2d85f5 req-0c86b934-92f9-45cb-b5f4-711085bc8b0b tempest-TestInstancesWithCinderVolumes-278728036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:52:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-7e739f63-59e9-4bfe-a678-65ea1e2d85f5 req-0c86b934-92f9-45cb-b5f4-711085bc8b0b tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:52:18 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2f07d3df-49e7-41be-b0a3-7cd6f32404da tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-214d64a8-4b36-47e0-9c2c-b55c983dbc0b" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:52:18 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-2f07d3df-49e7-41be-b0a3-7cd6f32404da tempest-GroupSnapshotsTest-789445324 None] Deleting offline snapshot 214d64a8-4b36-47e0-9c2c-b55c983dbc0b of volume e78ca21e-cf8e-422c-9177-3b82a6175797 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 11:52:18 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-2f07d3df-49e7-41be-b0a3-7cd6f32404da tempest-GroupSnapshotsTest-789445324 None] snapshot_file for this snap is: volume-e78ca21e-cf8e-422c-9177-3b82a6175797.214d64a8-4b36-47e0-9c2c-b55c983dbc0b {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 11:52:18 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f73a3f-97d2-4c8e-938d-2ff058d68bdd]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:52:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-7e739f63-59e9-4bfe-a678-65ea1e2d85f5 req-0c86b934-92f9-45cb-b5f4-711085bc8b0b tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:18 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe5ead0-bebd-4d70-88ec-ba37abe4ab4f]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:52:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2f07d3df-49e7-41be-b0a3-7cd6f32404da tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797.214d64a8-4b36-47e0-9c2c-b55c983dbc0b {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-7e739f63-59e9-4bfe-a678-65ea1e2d85f5 req-0c86b934-92f9-45cb-b5f4-711085bc8b0b tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e" returned: 0 in 0.699s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-7e739f63-59e9-4bfe-a678-65ea1e2d85f5 req-0c86b934-92f9-45cb-b5f4-711085bc8b0b tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2f07d3df-49e7-41be-b0a3-7cd6f32404da tempest-GroupSnapshotsTest-789445324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797.214d64a8-4b36-47e0-9c2c-b55c983dbc0b" returned: 0 in 0.735s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:19 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-2f07d3df-49e7-41be-b0a3-7cd6f32404da tempest-GroupSnapshotsTest-789445324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e78ca21e-cf8e-422c-9177-3b82a6175797(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:52:19 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8323ef5-fe7c-44ad-a0be-55cddc90df00]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:52:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2f07d3df-49e7-41be-b0a3-7cd6f32404da tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-7e739f63-59e9-4bfe-a678-65ea1e2d85f5 req-0c86b934-92f9-45cb-b5f4-711085bc8b0b tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e" returned: 1 in 0.589s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-7e739f63-59e9-4bfe-a678-65ea1e2d85f5 req-0c86b934-92f9-45cb-b5f4-711085bc8b0b tempest-TestInstancesWithCinderVolumes-278728036 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 11:52:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-7e739f63-59e9-4bfe-a678-65ea1e2d85f5 req-0c86b934-92f9-45cb-b5f4-711085bc8b0b tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.469s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:52:20 devstack quobyte-client[82616]: System call of process 94504 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:52:20 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=83,cinder:SELECT=94,cinder:INSERT=20,cinder:DELETE=3 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:52:20 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=84,cinder:SELECT=88,cinder:INSERT=20,cinder:DELETE=3 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:52:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2f07d3df-49e7-41be-b0a3-7cd6f32404da tempest-GroupSnapshotsTest-789445324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797" returned: 0 in 0.755s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2f07d3df-49e7-41be-b0a3-7cd6f32404da tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797.214d64a8-4b36-47e0-9c2c-b55c983dbc0b {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:20 devstack quobyte-client[82616]: System call of process 94510 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:52:20 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-7e739f63-59e9-4bfe-a678-65ea1e2d85f5 req-0c86b934-92f9-45cb-b5f4-711085bc8b0b tempest-TestInstancesWithCinderVolumes-278728036 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56', 'name': 'volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '66955212-72fe-404e-861b-f1ed06394da6', 'enforce_multipath': True} {{(pid=82594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 11:52:20 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-7e739f63-59e9-4bfe-a678-65ea1e2d85f5 req-0c86b934-92f9-45cb-b5f4-711085bc8b0b tempest-TestInstancesWithCinderVolumes-278728036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:52:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2f07d3df-49e7-41be-b0a3-7cd6f32404da tempest-GroupSnapshotsTest-789445324 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797.214d64a8-4b36-47e0-9c2c-b55c983dbc0b" returned: 0 in 0.512s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2f07d3df-49e7-41be-b0a3-7cd6f32404da tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797.214d64a8-4b36-47e0-9c2c-b55c983dbc0b {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2f07d3df-49e7-41be-b0a3-7cd6f32404da tempest-GroupSnapshotsTest-789445324 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797.214d64a8-4b36-47e0-9c2c-b55c983dbc0b" returned: 0 in 0.308s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:21 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2f07d3df-49e7-41be-b0a3-7cd6f32404da tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-214d64a8-4b36-47e0-9c2c-b55c983dbc0b" released by "_delete_snapshot" :: held 2.799s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:52:21 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2f07d3df-49e7-41be-b0a3-7cd6f32404da tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-e78ca21e-cf8e-422c-9177-3b82a6175797" released by "delete_snapshot" :: held 2.941s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:52:21 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-7e739f63-59e9-4bfe-a678-65ea1e2d85f5 req-0c86b934-92f9-45cb-b5f4-711085bc8b0b tempest-TestInstancesWithCinderVolumes-278728036 None] attachment_update completed successfully.
Sep 10 11:52:21 devstack cinder-volume[82594]: WARNING cinder.quota [None req-2f07d3df-49e7-41be-b0a3-7cd6f32404da tempest-GroupSnapshotsTest-789445324 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-650924643 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-650924643, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:52:21 devstack cinder-volume[82594]: WARNING cinder.quota [None req-2f07d3df-49e7-41be-b0a3-7cd6f32404da tempest-GroupSnapshotsTest-789445324 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-650924643 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-650924643, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:52:21 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-2f07d3df-49e7-41be-b0a3-7cd6f32404da tempest-GroupSnapshotsTest-789445324 None] Created reservations ['ded9563e-3bc2-439f-9c8d-b6b9396d6c72', 'f73a4da1-b767-41fb-842d-b33402221f4a', '6f00d21c-3bca-4e1d-a2ca-46505379ed40', 'c62ce6f9-4df4-425e-9120-42f8850c732e'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:52:21 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-2f07d3df-49e7-41be-b0a3-7cd6f32404da tempest-GroupSnapshotsTest-789445324 None] group_snapshot 0c5151f4-a464-4eff-910a-cef26d4f766f: deleted successfully
Sep 10 11:52:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:52:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:52:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:52:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:52:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:52:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:52:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.134s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:22 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:52:24 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-4c7fc69e-b7e1-4b3e-ac3b-12a1cf0f88b1 tempest-GroupSnapshotsTest-789445324 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:52:24 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-4c7fc69e-b7e1-4b3e-ac3b-12a1cf0f88b1 tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "cinder-quobyte-e78ca21e-cf8e-422c-9177-3b82a6175797" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:52:24 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-4c7fc69e-b7e1-4b3e-ac3b-12a1cf0f88b1 tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-e78ca21e-cf8e-422c-9177-3b82a6175797" acquired by "delete_volume" :: waited 0.087s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:52:24 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3637d66-d443-436d-874b-aff261a4eade]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:52:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4c7fc69e-b7e1-4b3e-ac3b-12a1cf0f88b1 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4c7fc69e-b7e1-4b3e-ac3b-12a1cf0f88b1 tempest-GroupSnapshotsTest-789445324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797" returned: 0 in 0.519s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4c7fc69e-b7e1-4b3e-ac3b-12a1cf0f88b1 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4c7fc69e-b7e1-4b3e-ac3b-12a1cf0f88b1 tempest-GroupSnapshotsTest-789445324 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e78ca21e-cf8e-422c-9177-3b82a6175797" returned: 0 in 0.121s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:25 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-4c7fc69e-b7e1-4b3e-ac3b-12a1cf0f88b1 tempest-GroupSnapshotsTest-789445324 None] Lock "cinder-quobyte-e78ca21e-cf8e-422c-9177-3b82a6175797" released by "delete_volume" :: held 0.877s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:52:25 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-4c7fc69e-b7e1-4b3e-ac3b-12a1cf0f88b1 tempest-GroupSnapshotsTest-789445324 None] Created reservations ['de380075-e404-40ab-9e5e-f6160a158836'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:52:25 devstack cinder-volume[82594]: WARNING cinder.quota [None req-4c7fc69e-b7e1-4b3e-ac3b-12a1cf0f88b1 tempest-GroupSnapshotsTest-789445324 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-650924643 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-650924643, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:52:25 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-4c7fc69e-b7e1-4b3e-ac3b-12a1cf0f88b1 tempest-GroupSnapshotsTest-789445324 None] Created reservations ['a5063918-9eb2-4e6e-bec5-509978bda6e3', '3c0efbbb-48fd-4910-870b-2b0d82626fad', 'a82776f5-7359-4a6a-b72b-d85b37638b42', 'cb7f70fd-47c2-4994-9ebd-6cd511ab9f04'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:52:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4c7fc69e-b7e1-4b3e-ac3b-12a1cf0f88b1 tempest-GroupSnapshotsTest-789445324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:52:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4c7fc69e-b7e1-4b3e-ac3b-12a1cf0f88b1 tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:52:25 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4c7fc69e-b7e1-4b3e-ac3b-12a1cf0f88b1 tempest-GroupSnapshotsTest-789445324 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:52:25 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4c7fc69e-b7e1-4b3e-ac3b-12a1cf0f88b1 tempest-GroupSnapshotsTest-789445324 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:52:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4c7fc69e-b7e1-4b3e-ac3b-12a1cf0f88b1 tempest-GroupSnapshotsTest-789445324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:52:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4c7fc69e-b7e1-4b3e-ac3b-12a1cf0f88b1 tempest-GroupSnapshotsTest-789445324 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:52:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4c7fc69e-b7e1-4b3e-ac3b-12a1cf0f88b1 tempest-GroupSnapshotsTest-789445324 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.166s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:52:26 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-4c7fc69e-b7e1-4b3e-ac3b-12a1cf0f88b1 tempest-GroupSnapshotsTest-789445324 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:52:26 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-4c7fc69e-b7e1-4b3e-ac3b-12a1cf0f88b1 tempest-GroupSnapshotsTest-789445324 None] Delete group completed successfully.
Sep 10 11:52:35 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=17,cinder:INSERT=4,cinder:UPDATE=13 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:52:35 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=19,cinder:UPDATE=24,cinder:INSERT=5 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:53:05 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:53:05 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:53:05 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Flow 'volume_create_manager' (998cf7a1-f6a9-4109-b4ce-0db516cd4c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:53:05 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07c8dd1-ddda-48f9-8e85-1c38cb810d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:53:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07c8dd1-ddda-48f9-8e85-1c38cb810d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1735264937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4595159d-3535-4684-9a4e-9edc9ae0cd77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7543c221302a4de7b77a1e485b3a4d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:53:06Z,use_quota=True,user_id='d80052a3e98b487da03f2ebcd95380d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:53:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ac7b81-6fa8-44a1-9617-68c964ca99ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:53:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ac7b81-6fa8-44a1-9617-68c964ca99ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:53:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a4e9701-a926-411e-8360-63492793b313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:53:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a4e9701-a926-411e-8360-63492793b313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4595159d-3535-4684-9a4e-9edc9ae0cd77', 'volume_name': 'volume-4595159d-3535-4684-9a4e-9edc9ae0cd77', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:53:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d0f9c63-737a-4508-81a1-bd1e98f7f5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:53:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d0f9c63-737a-4508-81a1-bd1e98f7f5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:53:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f8c5e2-09f5-4056-87d1-1eb3d708ec82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:53:06 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Volume 4595159d-3535-4684-9a4e-9edc9ae0cd77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4595159d-3535-4684-9a4e-9edc9ae0cd77', 'volume_size': 1}
Sep 10 11:53:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:53:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:53:06 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1735264937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4595159d-3535-4684-9a4e-9edc9ae0cd77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7543c221302a4de7b77a1e485b3a4d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:53:06Z,use_quota=True,user_id='d80052a3e98b487da03f2ebcd95380d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:53:06 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Creating volume 4595159d-3535-4684-9a4e-9edc9ae0cd77 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:53:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:53:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:53:06 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:53:06 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:53:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:53:06 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:53:06 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:53:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4595159d-3535-4684-9a4e-9edc9ae0cd77 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:53:06 devstack quobyte-client[82616]: System call of process 95051 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:53:06 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=92, name=volume-4595159d-3535-4684-9a4e-9edc9ae0cd77, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:53:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4595159d-3535-4684-9a4e-9edc9ae0cd77 1073741824" returned: 0 in 0.437s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:53:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4595159d-3535-4684-9a4e-9edc9ae0cd77 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:53:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4595159d-3535-4684-9a4e-9edc9ae0cd77" returned: 0 in 0.198s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:53:06 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] <== create_volume: return (713ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:53:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:53:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f8c5e2-09f5-4056-87d1-1eb3d708ec82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4595159d-3535-4684-9a4e-9edc9ae0cd77', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:53:07 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b2ff32-1942-4e6d-9dd3-788388d4e652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:53:07 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Volume volume-4595159d-3535-4684-9a4e-9edc9ae0cd77 (4595159d-3535-4684-9a4e-9edc9ae0cd77): created successfully
Sep 10 11:53:07 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b2ff32-1942-4e6d-9dd3-788388d4e652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:53:07 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Flow 'volume_create_manager' (998cf7a1-f6a9-4109-b4ce-0db516cd4c3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:53:07 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-5bea87f0-72c1-4830-98f8-1f39757acbb2 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Created volume successfully.
Sep 10 11:53:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-dcb32c0d-a9e6-4750-8c74-25778017e8f0 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Acquiring lock "cinder-4595159d-3535-4684-9a4e-9edc9ae0cd77-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:53:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-dcb32c0d-a9e6-4750-8c74-25778017e8f0 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Lock "cinder-4595159d-3535-4684-9a4e-9edc9ae0cd77-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:53:08 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-dcb32c0d-a9e6-4750-8c74-25778017e8f0 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:53:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-dcb32c0d-a9e6-4750-8c74-25778017e8f0 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Acquiring lock "cinder-quobyte-4595159d-3535-4684-9a4e-9edc9ae0cd77" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:53:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-dcb32c0d-a9e6-4750-8c74-25778017e8f0 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Lock "cinder-quobyte-4595159d-3535-4684-9a4e-9edc9ae0cd77" acquired by "delete_volume" :: waited 0.016s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:53:08 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fd6d6a-9401-444c-970c-4cb603fb8dbe]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:53:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-dcb32c0d-a9e6-4750-8c74-25778017e8f0 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4595159d-3535-4684-9a4e-9edc9ae0cd77 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:53:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-dcb32c0d-a9e6-4750-8c74-25778017e8f0 tempest-VolumeQuotasAdminTestJSON-2066598520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4595159d-3535-4684-9a4e-9edc9ae0cd77" returned: 0 in 0.495s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:53:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-dcb32c0d-a9e6-4750-8c74-25778017e8f0 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4595159d-3535-4684-9a4e-9edc9ae0cd77 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:53:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-dcb32c0d-a9e6-4750-8c74-25778017e8f0 tempest-VolumeQuotasAdminTestJSON-2066598520 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4595159d-3535-4684-9a4e-9edc9ae0cd77" returned: 0 in 0.117s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:53:09 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-dcb32c0d-a9e6-4750-8c74-25778017e8f0 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Lock "cinder-quobyte-4595159d-3535-4684-9a4e-9edc9ae0cd77" released by "delete_volume" :: held 0.813s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:53:09 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-dcb32c0d-a9e6-4750-8c74-25778017e8f0 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Created reservations ['686de593-9fdb-4ef2-b703-8df4c49935da', 'a38cbea5-c175-4067-ba5b-faf56db21d2c', '9164c935-7a9e-4813-8569-54f7595a10b3', '3ebb6bfc-0eb7-46c1-b193-4f8ba4d99bbf'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:53:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-dcb32c0d-a9e6-4750-8c74-25778017e8f0 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:53:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-dcb32c0d-a9e6-4750-8c74-25778017e8f0 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:53:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-dcb32c0d-a9e6-4750-8c74-25778017e8f0 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:53:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-dcb32c0d-a9e6-4750-8c74-25778017e8f0 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:53:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-dcb32c0d-a9e6-4750-8c74-25778017e8f0 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:53:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-dcb32c0d-a9e6-4750-8c74-25778017e8f0 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:53:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-dcb32c0d-a9e6-4750-8c74-25778017e8f0 tempest-VolumeQuotasAdminTestJSON-2066598520 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.086s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:53:09 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-dcb32c0d-a9e6-4750-8c74-25778017e8f0 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:53:09 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-dcb32c0d-a9e6-4750-8c74-25778017e8f0 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Deleted volume successfully.
Sep 10 11:53:10 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-dcb32c0d-a9e6-4750-8c74-25778017e8f0 tempest-VolumeQuotasAdminTestJSON-2066598520 None] Lock "cinder-4595159d-3535-4684-9a4e-9edc9ae0cd77-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:53:11 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Flow 'volume_create_manager' (7f8b0062-6cb2-4063-8237-ff42f92e1a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b250b2da-d3bf-42af-8e3f-a5ee629630ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b250b2da-d3bf-42af-8e3f-a5ee629630ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-332210445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3551ad5-2968-4146-b6b3-d2be73e0780a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7543c221302a4de7b77a1e485b3a4d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:53:11Z,use_quota=True,user_id='d80052a3e98b487da03f2ebcd95380d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6af386e6-5d8c-4d5e-aef0-772f049900a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6af386e6-5d8c-4d5e-aef0-772f049900a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91de44c-a839-4333-94ee-ea56ee8539e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91de44c-a839-4333-94ee-ea56ee8539e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3551ad5-2968-4146-b6b3-d2be73e0780a', 'volume_name': 'volume-b3551ad5-2968-4146-b6b3-d2be73e0780a', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4bdd3ab-fa4a-4883-955b-516a02842790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4bdd3ab-fa4a-4883-955b-516a02842790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf0008a-9cd4-445e-8af9-9ee71ab4f4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:53:11 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Volume b3551ad5-2968-4146-b6b3-d2be73e0780a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3551ad5-2968-4146-b6b3-d2be73e0780a', 'volume_size': 1}
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-332210445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3551ad5-2968-4146-b6b3-d2be73e0780a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7543c221302a4de7b77a1e485b3a4d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:53:11Z,use_quota=True,user_id='d80052a3e98b487da03f2ebcd95380d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Creating volume b3551ad5-2968-4146-b6b3-d2be73e0780a {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:53:11 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b3551ad5-2968-4146-b6b3-d2be73e0780a 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:53:11 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=93, name=volume-b3551ad5-2968-4146-b6b3-d2be73e0780a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b3551ad5-2968-4146-b6b3-d2be73e0780a 1073741824" returned: 0 in 0.434s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b3551ad5-2968-4146-b6b3-d2be73e0780a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b3551ad5-2968-4146-b6b3-d2be73e0780a" returned: 0 in 0.096s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] <== create_volume: return (597ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:53:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.607s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:53:12 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf0008a-9cd4-445e-8af9-9ee71ab4f4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3551ad5-2968-4146-b6b3-d2be73e0780a', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:53:12 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7200ed3b-c005-4697-b6a8-fc56793a9ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:53:12 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Volume volume-b3551ad5-2968-4146-b6b3-d2be73e0780a (b3551ad5-2968-4146-b6b3-d2be73e0780a): created successfully
Sep 10 11:53:12 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7200ed3b-c005-4697-b6a8-fc56793a9ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:53:12 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Flow 'volume_create_manager' (7f8b0062-6cb2-4063-8237-ff42f92e1a9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:53:12 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-d3dd7871-c96c-4f41-8d4d-34652f82227c tempest-VolumeQuotasAdminTestJSON-2066598520 None] Created volume successfully.
Sep 10 11:53:14 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-6a22885e-b864-4376-bf78-441f5d51446d tempest-VolumeQuotasAdminTestJSON-1346185544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:53:14 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-6a22885e-b864-4376-bf78-441f5d51446d tempest-VolumeQuotasAdminTestJSON-1346185544 None] Transfer volume completed successfully.
Sep 10 11:53:15 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ed52c8b6-2cbb-4986-9ac1-fd08b135c9cb tempest-VolumeQuotasAdminTestJSON-1750871749 None] Acquiring lock "cinder-b3551ad5-2968-4146-b6b3-d2be73e0780a-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:53:15 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ed52c8b6-2cbb-4986-9ac1-fd08b135c9cb tempest-VolumeQuotasAdminTestJSON-1750871749 None] Lock "cinder-b3551ad5-2968-4146-b6b3-d2be73e0780a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:53:15 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-ed52c8b6-2cbb-4986-9ac1-fd08b135c9cb tempest-VolumeQuotasAdminTestJSON-1750871749 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:53:15 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ed52c8b6-2cbb-4986-9ac1-fd08b135c9cb tempest-VolumeQuotasAdminTestJSON-1750871749 None] Acquiring lock "cinder-quobyte-b3551ad5-2968-4146-b6b3-d2be73e0780a" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:53:15 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ed52c8b6-2cbb-4986-9ac1-fd08b135c9cb tempest-VolumeQuotasAdminTestJSON-1750871749 None] Lock "cinder-quobyte-b3551ad5-2968-4146-b6b3-d2be73e0780a" acquired by "delete_volume" :: waited 0.017s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:53:15 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3721a00b-dca6-42cf-96b1-e8679b8babdc]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:53:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ed52c8b6-2cbb-4986-9ac1-fd08b135c9cb tempest-VolumeQuotasAdminTestJSON-1750871749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b3551ad5-2968-4146-b6b3-d2be73e0780a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:53:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ed52c8b6-2cbb-4986-9ac1-fd08b135c9cb tempest-VolumeQuotasAdminTestJSON-1750871749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b3551ad5-2968-4146-b6b3-d2be73e0780a" returned: 0 in 0.462s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:53:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ed52c8b6-2cbb-4986-9ac1-fd08b135c9cb tempest-VolumeQuotasAdminTestJSON-1750871749 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b3551ad5-2968-4146-b6b3-d2be73e0780a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:53:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ed52c8b6-2cbb-4986-9ac1-fd08b135c9cb tempest-VolumeQuotasAdminTestJSON-1750871749 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b3551ad5-2968-4146-b6b3-d2be73e0780a" returned: 0 in 0.137s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:53:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ed52c8b6-2cbb-4986-9ac1-fd08b135c9cb tempest-VolumeQuotasAdminTestJSON-1750871749 None] Lock "cinder-quobyte-b3551ad5-2968-4146-b6b3-d2be73e0780a" released by "delete_volume" :: held 0.773s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:53:16 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-ed52c8b6-2cbb-4986-9ac1-fd08b135c9cb tempest-VolumeQuotasAdminTestJSON-1750871749 None] Created reservations ['f8c654ab-fde3-477a-a83e-5f09e83c31cf', 'a1dba1d5-256f-4fea-8e88-5fda8d4acb9a', 'fe8fc2da-5bae-4389-a30f-3fcf23d9a692', '5ea17cb5-c44f-47a7-b3de-4b78b5b9bcc0'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:53:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ed52c8b6-2cbb-4986-9ac1-fd08b135c9cb tempest-VolumeQuotasAdminTestJSON-1750871749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:53:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ed52c8b6-2cbb-4986-9ac1-fd08b135c9cb tempest-VolumeQuotasAdminTestJSON-1750871749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:53:17 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ed52c8b6-2cbb-4986-9ac1-fd08b135c9cb tempest-VolumeQuotasAdminTestJSON-1750871749 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:53:17 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ed52c8b6-2cbb-4986-9ac1-fd08b135c9cb tempest-VolumeQuotasAdminTestJSON-1750871749 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:53:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ed52c8b6-2cbb-4986-9ac1-fd08b135c9cb tempest-VolumeQuotasAdminTestJSON-1750871749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:53:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ed52c8b6-2cbb-4986-9ac1-fd08b135c9cb tempest-VolumeQuotasAdminTestJSON-1750871749 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:53:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ed52c8b6-2cbb-4986-9ac1-fd08b135c9cb tempest-VolumeQuotasAdminTestJSON-1750871749 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.088s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:53:17 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-ed52c8b6-2cbb-4986-9ac1-fd08b135c9cb tempest-VolumeQuotasAdminTestJSON-1750871749 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:53:17 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-ed52c8b6-2cbb-4986-9ac1-fd08b135c9cb tempest-VolumeQuotasAdminTestJSON-1750871749 None] Deleted volume successfully.
Sep 10 11:53:17 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ed52c8b6-2cbb-4986-9ac1-fd08b135c9cb tempest-VolumeQuotasAdminTestJSON-1750871749 None] Lock "cinder-b3551ad5-2968-4146-b6b3-d2be73e0780a-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:53:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:53:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:53:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:53:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:53:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:53:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:53:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:53:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.140s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:53:22 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:53:27 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=17,cinder:SELECT=11,cinder:DELETE=2,cinder:INSERT=5 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:53:27 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=14,cinder:UPDATE=23,cinder:INSERT=3,cinder:DELETE=2 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:53:28 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:53:28 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:53:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Flow 'volume_create_manager' (95c7497b-2e3f-4edc-9a0c-09f224db71dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:53:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (965035be-a586-4a66-8098-5008931e1538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:53:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (965035be-a586-4a66-8098-5008931e1538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1494659999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a90713-9b6a-4406-b7ab-2b40a823aa8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a742259c8ac24e80a53962c85547bbb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:53:28Z,use_quota=True,user_id='c2f97cad44124f678b6130ed0f940be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:53:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a45d44-1ff3-406a-9f01-2089348d55b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:53:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a45d44-1ff3-406a-9f01-2089348d55b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:53:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78fb0816-00d3-4d2e-924e-0a9a4218dd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:53:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78fb0816-00d3-4d2e-924e-0a9a4218dd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03a90713-9b6a-4406-b7ab-2b40a823aa8a', 'volume_name': 'volume-03a90713-9b6a-4406-b7ab-2b40a823aa8a', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:53:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57392068-4523-42b2-85aa-abbd3e525d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:53:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57392068-4523-42b2-85aa-abbd3e525d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:53:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd2600c-3536-4fe2-8dc8-b8bc2d885a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:53:28 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Volume 03a90713-9b6a-4406-b7ab-2b40a823aa8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03a90713-9b6a-4406-b7ab-2b40a823aa8a', 'volume_size': 1}
Sep 10 11:53:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:53:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.016s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:53:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1494659999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a90713-9b6a-4406-b7ab-2b40a823aa8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a742259c8ac24e80a53962c85547bbb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:53:28Z,use_quota=True,user_id='c2f97cad44124f678b6130ed0f940be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:53:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Creating volume 03a90713-9b6a-4406-b7ab-2b40a823aa8a {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:53:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:53:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:53:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:53:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:53:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:53:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:53:28 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:53:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-03a90713-9b6a-4406-b7ab-2b40a823aa8a 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:53:28 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=94, name=volume-03a90713-9b6a-4406-b7ab-2b40a823aa8a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:53:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-03a90713-9b6a-4406-b7ab-2b40a823aa8a 1073741824" returned: 0 in 0.408s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:53:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-03a90713-9b6a-4406-b7ab-2b40a823aa8a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:53:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-03a90713-9b6a-4406-b7ab-2b40a823aa8a" returned: 0 in 0.130s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:53:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] <== create_volume: return (595ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:53:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.615s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:53:29 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd2600c-3536-4fe2-8dc8-b8bc2d885a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03a90713-9b6a-4406-b7ab-2b40a823aa8a', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:53:29 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (605b753c-d84e-4513-92f4-fad756ca84d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:53:29 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Volume volume-03a90713-9b6a-4406-b7ab-2b40a823aa8a (03a90713-9b6a-4406-b7ab-2b40a823aa8a): created successfully
Sep 10 11:53:29 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (605b753c-d84e-4513-92f4-fad756ca84d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:53:29 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Flow 'volume_create_manager' (95c7497b-2e3f-4edc-9a0c-09f224db71dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:53:29 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-ea7beda9-edb5-4e89-93db-6ae8635830da tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Created volume successfully.
Sep 10 11:53:31 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-04dd0cdf-c61b-4dd6-9649-1ef41276b482 tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Acquiring lock "cinder-03a90713-9b6a-4406-b7ab-2b40a823aa8a-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:53:31 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-04dd0cdf-c61b-4dd6-9649-1ef41276b482 tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Lock "cinder-03a90713-9b6a-4406-b7ab-2b40a823aa8a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:53:31 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-04dd0cdf-c61b-4dd6-9649-1ef41276b482 tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:53:31 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-04dd0cdf-c61b-4dd6-9649-1ef41276b482 tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Acquiring lock "cinder-quobyte-03a90713-9b6a-4406-b7ab-2b40a823aa8a" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:53:31 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-04dd0cdf-c61b-4dd6-9649-1ef41276b482 tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Lock "cinder-quobyte-03a90713-9b6a-4406-b7ab-2b40a823aa8a" acquired by "delete_volume" :: waited 0.014s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:53:31 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[66be3692-6939-4f03-adea-deaad5a556d2]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:53:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-04dd0cdf-c61b-4dd6-9649-1ef41276b482 tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-03a90713-9b6a-4406-b7ab-2b40a823aa8a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:53:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-04dd0cdf-c61b-4dd6-9649-1ef41276b482 tempest-VolumeQuotasNegativeTestJSON-1133362185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-03a90713-9b6a-4406-b7ab-2b40a823aa8a" returned: 0 in 0.456s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:53:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-04dd0cdf-c61b-4dd6-9649-1ef41276b482 tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-03a90713-9b6a-4406-b7ab-2b40a823aa8a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:53:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-04dd0cdf-c61b-4dd6-9649-1ef41276b482 tempest-VolumeQuotasNegativeTestJSON-1133362185 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-03a90713-9b6a-4406-b7ab-2b40a823aa8a" returned: 0 in 0.087s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:53:32 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-04dd0cdf-c61b-4dd6-9649-1ef41276b482 tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Lock "cinder-quobyte-03a90713-9b6a-4406-b7ab-2b40a823aa8a" released by "delete_volume" :: held 0.695s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:53:32 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-04dd0cdf-c61b-4dd6-9649-1ef41276b482 tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Created reservations ['0d625362-405f-4956-aca2-29eebc30f6c3', '8f4bbc4b-1434-4714-b204-ae85df665c31', 'a2331831-71f4-42c4-bf8e-bc28fbaf640c', '315e0f9b-f22f-46a6-bf31-4f3ec55c7ae0'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:53:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-04dd0cdf-c61b-4dd6-9649-1ef41276b482 tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:53:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-04dd0cdf-c61b-4dd6-9649-1ef41276b482 tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:53:33 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-04dd0cdf-c61b-4dd6-9649-1ef41276b482 tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:53:33 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-04dd0cdf-c61b-4dd6-9649-1ef41276b482 tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:53:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-04dd0cdf-c61b-4dd6-9649-1ef41276b482 tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:53:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-04dd0cdf-c61b-4dd6-9649-1ef41276b482 tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:53:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-04dd0cdf-c61b-4dd6-9649-1ef41276b482 tempest-VolumeQuotasNegativeTestJSON-1133362185 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.096s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:53:33 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-04dd0cdf-c61b-4dd6-9649-1ef41276b482 tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:53:33 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-04dd0cdf-c61b-4dd6-9649-1ef41276b482 tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Deleted volume successfully.
Sep 10 11:53:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-04dd0cdf-c61b-4dd6-9649-1ef41276b482 tempest-VolumeQuotasNegativeTestJSON-1133362185 None] Lock "cinder-03a90713-9b6a-4406-b7ab-2b40a823aa8a-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:53:42 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=8,cinder:UPDATE=10,cinder:DELETE=1,cinder:INSERT=4 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:53:43 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=4,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:53:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-39cfcd1d-a930-4b29-ad66-95394068b961 req-db13764d-61e4-4906-bfcd-f388ed82baef tempest-TestInstancesWithCinderVolumes-278728036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:53:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-39cfcd1d-a930-4b29-ad66-95394068b961 req-db13764d-61e4-4906-bfcd-f388ed82baef tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:53:46 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55b3730-ead3-43e4-9b02-1b87d092d447]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:53:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-39cfcd1d-a930-4b29-ad66-95394068b961 req-db13764d-61e4-4906-bfcd-f388ed82baef tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4bec92ae-9fe3-4756-84a6-4a50f198f2b1 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:53:47 devstack quobyte-client[82616]: System call of process 95136 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:53:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-39cfcd1d-a930-4b29-ad66-95394068b961 req-db13764d-61e4-4906-bfcd-f388ed82baef tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4bec92ae-9fe3-4756-84a6-4a50f198f2b1" returned: 0 in 0.598s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:53:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-39cfcd1d-a930-4b29-ad66-95394068b961 req-db13764d-61e4-4906-bfcd-f388ed82baef tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.678s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:53:47 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-39cfcd1d-a930-4b29-ad66-95394068b961 req-db13764d-61e4-4906-bfcd-f388ed82baef tempest-TestInstancesWithCinderVolumes-278728036 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56', 'name': 'volume-4bec92ae-9fe3-4756-84a6-4a50f198f2b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03a90cd2-cd7d-46cb-b1b7-63221e23419e', 'enforce_multipath': True} {{(pid=82594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 11:53:47 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-39cfcd1d-a930-4b29-ad66-95394068b961 req-db13764d-61e4-4906-bfcd-f388ed82baef tempest-TestInstancesWithCinderVolumes-278728036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:53:48 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-39cfcd1d-a930-4b29-ad66-95394068b961 req-db13764d-61e4-4906-bfcd-f388ed82baef tempest-TestInstancesWithCinderVolumes-278728036 None] attachment_update completed successfully.
Sep 10 11:53:49 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:53:49 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:53:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Flow 'volume_create_manager' (39ffff06-bf5d-41e6-8fdb-c4a5df51eecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:53:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7053f614-9e46-45fa-a5b3-868e9b19cf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:53:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7053f614-9e46-45fa-a5b3-868e9b19cf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-357498086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e5cb66b-0e56-4109-9f01-62170882cbf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5baf711cb03b4a8fa6bfbf7801b6ab74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:53:49Z,use_quota=True,user_id='78e1d1fc0190418aa1b585e01f657fe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9a5c1aa-0835-42ca-9e5c-c8ed0e68bca6),volume_type_id=c9a5c1aa-0835-42ca-9e5c-c8ed0e68bca6)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:53:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73268b90-13ec-411b-b8e4-b14fdfc21061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:53:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73268b90-13ec-411b-b8e4-b14fdfc21061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:53:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d3f1b1-7f6b-46c0-93f2-cf48cb47047d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:53:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d3f1b1-7f6b-46c0-93f2-cf48cb47047d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e5cb66b-0e56-4109-9f01-62170882cbf0', 'volume_name': 'volume-9e5cb66b-0e56-4109-9f01-62170882cbf0', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:53:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55ff09e5-c479-4d71-a228-aca69bd76243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:53:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55ff09e5-c479-4d71-a228-aca69bd76243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:53:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1d8f67-86f6-4122-a4d0-5008fc621de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:53:49 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Volume 9e5cb66b-0e56-4109-9f01-62170882cbf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e5cb66b-0e56-4109-9f01-62170882cbf0', 'volume_size': 1}
Sep 10 11:53:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:53:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:53:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-357498086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e5cb66b-0e56-4109-9f01-62170882cbf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5baf711cb03b4a8fa6bfbf7801b6ab74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:53:49Z,use_quota=True,user_id='78e1d1fc0190418aa1b585e01f657fe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9a5c1aa-0835-42ca-9e5c-c8ed0e68bca6),volume_type_id=c9a5c1aa-0835-42ca-9e5c-c8ed0e68bca6)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:53:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Creating volume 9e5cb66b-0e56-4109-9f01-62170882cbf0 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:53:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:53:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:53:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:53:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:53:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:53:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:53:49 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:53:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9e5cb66b-0e56-4109-9f01-62170882cbf0 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:53:49 devstack quobyte-client[82616]: System call of process 95140 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:53:49 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=95, name=volume-9e5cb66b-0e56-4109-9f01-62170882cbf0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:53:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9e5cb66b-0e56-4109-9f01-62170882cbf0 1073741824" returned: 0 in 0.453s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:53:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9e5cb66b-0e56-4109-9f01-62170882cbf0 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:53:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9e5cb66b-0e56-4109-9f01-62170882cbf0" returned: 0 in 0.181s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:53:50 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] <== create_volume: return (763ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:53:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:53:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1d8f67-86f6-4122-a4d0-5008fc621de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e5cb66b-0e56-4109-9f01-62170882cbf0', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:53:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8bc57e1-d852-4934-90a7-7da1709efd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:53:50 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Volume volume-9e5cb66b-0e56-4109-9f01-62170882cbf0 (9e5cb66b-0e56-4109-9f01-62170882cbf0): created successfully
Sep 10 11:53:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8bc57e1-d852-4934-90a7-7da1709efd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:53:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Flow 'volume_create_manager' (39ffff06-bf5d-41e6-8fdb-c4a5df51eecf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:53:50 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-ef485e7c-f3c8-48bf-b507-1705f573059b tempest-VolumeTypesAccessTest-387201800 None] Created volume successfully.
Sep 10 11:53:51 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-542fa1a4-9aca-440f-821f-292653b1c06c tempest-VolumeTypesAccessTest-387201800 None] Acquiring lock "cinder-9e5cb66b-0e56-4109-9f01-62170882cbf0-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:53:51 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-542fa1a4-9aca-440f-821f-292653b1c06c tempest-VolumeTypesAccessTest-387201800 None] Lock "cinder-9e5cb66b-0e56-4109-9f01-62170882cbf0-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:53:51 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-542fa1a4-9aca-440f-821f-292653b1c06c tempest-VolumeTypesAccessTest-387201800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:53:51 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-542fa1a4-9aca-440f-821f-292653b1c06c tempest-VolumeTypesAccessTest-387201800 None] Acquiring lock "cinder-quobyte-9e5cb66b-0e56-4109-9f01-62170882cbf0" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:53:51 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-542fa1a4-9aca-440f-821f-292653b1c06c tempest-VolumeTypesAccessTest-387201800 None] Lock "cinder-quobyte-9e5cb66b-0e56-4109-9f01-62170882cbf0" acquired by "delete_volume" :: waited 0.014s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:53:51 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a4cdeb-2ed1-4a11-9db6-749a2c5f3b61]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:53:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-542fa1a4-9aca-440f-821f-292653b1c06c tempest-VolumeTypesAccessTest-387201800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9e5cb66b-0e56-4109-9f01-62170882cbf0 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:53:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-542fa1a4-9aca-440f-821f-292653b1c06c tempest-VolumeTypesAccessTest-387201800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9e5cb66b-0e56-4109-9f01-62170882cbf0" returned: 0 in 0.416s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:53:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-542fa1a4-9aca-440f-821f-292653b1c06c tempest-VolumeTypesAccessTest-387201800 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9e5cb66b-0e56-4109-9f01-62170882cbf0 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:53:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-542fa1a4-9aca-440f-821f-292653b1c06c tempest-VolumeTypesAccessTest-387201800 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9e5cb66b-0e56-4109-9f01-62170882cbf0" returned: 0 in 0.114s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:53:52 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-542fa1a4-9aca-440f-821f-292653b1c06c tempest-VolumeTypesAccessTest-387201800 None] Lock "cinder-quobyte-9e5cb66b-0e56-4109-9f01-62170882cbf0" released by "delete_volume" :: held 0.717s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:53:52 devstack cinder-volume[82594]: WARNING cinder.quota [None req-542fa1a4-9aca-440f-821f-292653b1c06c tempest-VolumeTypesAccessTest-387201800 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-970216285 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-970216285, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:53:52 devstack cinder-volume[82594]: WARNING cinder.quota [None req-542fa1a4-9aca-440f-821f-292653b1c06c tempest-VolumeTypesAccessTest-387201800 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-970216285 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-970216285, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:53:52 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-542fa1a4-9aca-440f-821f-292653b1c06c tempest-VolumeTypesAccessTest-387201800 None] Created reservations ['1d057db0-baea-483b-8e9f-837a2c155d60', '80a3a1fd-5912-40ed-8388-381ab600ef60', 'efb738ce-d41f-4ff6-b63d-7fd327ae5538', '6b9184d6-000b-44ee-af00-8ac513a8683c'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:53:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-542fa1a4-9aca-440f-821f-292653b1c06c tempest-VolumeTypesAccessTest-387201800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:53:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-542fa1a4-9aca-440f-821f-292653b1c06c tempest-VolumeTypesAccessTest-387201800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:53:52 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-542fa1a4-9aca-440f-821f-292653b1c06c tempest-VolumeTypesAccessTest-387201800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:53:52 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-542fa1a4-9aca-440f-821f-292653b1c06c tempest-VolumeTypesAccessTest-387201800 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:53:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-542fa1a4-9aca-440f-821f-292653b1c06c tempest-VolumeTypesAccessTest-387201800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:53:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-542fa1a4-9aca-440f-821f-292653b1c06c tempest-VolumeTypesAccessTest-387201800 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:53:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-542fa1a4-9aca-440f-821f-292653b1c06c tempest-VolumeTypesAccessTest-387201800 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.164s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:53:53 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-542fa1a4-9aca-440f-821f-292653b1c06c tempest-VolumeTypesAccessTest-387201800 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:53:53 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-542fa1a4-9aca-440f-821f-292653b1c06c tempest-VolumeTypesAccessTest-387201800 None] Deleted volume successfully.
Sep 10 11:53:53 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-542fa1a4-9aca-440f-821f-292653b1c06c tempest-VolumeTypesAccessTest-387201800 None] Lock "cinder-9e5cb66b-0e56-4109-9f01-62170882cbf0-delete_volume" released by "delete_volume" :: held 2.138s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:54:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-c24573c6-1b49-4b01-910b-6bb95a5f1e1d req-b1a8a428-ba06-4b48-9c2f-f15457c53e4e tempest-TestInstancesWithCinderVolumes-278728036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:54:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-c24573c6-1b49-4b01-910b-6bb95a5f1e1d req-b1a8a428-ba06-4b48-9c2f-f15457c53e4e tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:54:00 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66c6a98-205e-48b2-9f89-d8618017dc71]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:54:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-c24573c6-1b49-4b01-910b-6bb95a5f1e1d req-b1a8a428-ba06-4b48-9c2f-f15457c53e4e tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-25af4e57-f266-481e-aba7-325fa60c9c89 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-c24573c6-1b49-4b01-910b-6bb95a5f1e1d req-b1a8a428-ba06-4b48-9c2f-f15457c53e4e tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-25af4e57-f266-481e-aba7-325fa60c9c89" returned: 0 in 0.478s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-c24573c6-1b49-4b01-910b-6bb95a5f1e1d req-b1a8a428-ba06-4b48-9c2f-f15457c53e4e tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.547s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:54:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-c24573c6-1b49-4b01-910b-6bb95a5f1e1d req-b1a8a428-ba06-4b48-9c2f-f15457c53e4e tempest-TestInstancesWithCinderVolumes-278728036 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56', 'name': 'volume-25af4e57-f266-481e-aba7-325fa60c9c89', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '222e82b7-2fa6-432f-a2a5-cdd7c8a00845', 'enforce_multipath': True} {{(pid=82594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 11:54:00 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-c24573c6-1b49-4b01-910b-6bb95a5f1e1d req-b1a8a428-ba06-4b48-9c2f-f15457c53e4e tempest-TestInstancesWithCinderVolumes-278728036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:54:01 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-c24573c6-1b49-4b01-910b-6bb95a5f1e1d req-b1a8a428-ba06-4b48-9c2f-f15457c53e4e tempest-TestInstancesWithCinderVolumes-278728036 None] attachment_update completed successfully.
Sep 10 11:54:16 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=19,cinder:UPDATE=13,cinder:DELETE=2,cinder:INSERT=2 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:54:16 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=16,cinder:UPDATE=14,cinder:INSERT=2 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:54:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:54:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:54:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:54:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:54:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:54:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:54:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.124s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:22 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:54:25 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Flow 'volume_create_manager' (05087743-35c6-4c64-9b70-dc32d13f7581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b885713d-a4b2-4bda-b14f-272c96e3c7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b885713d-a4b2-4bda-b14f-272c96e3c7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2087094231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb0f023-723e-4ac6-b6eb-8da5a30354ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e611d9257d84f7da02f5544e24e1e65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:54:25Z,use_quota=True,user_id='390e098a902246a9b54ba7b315189004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5080638-bd68-4e96-835a-8f500f524ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5080638-bd68-4e96-835a-8f500f524ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94efcc02-9fcf-4b5d-ba5c-a173d455e0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94efcc02-9fcf-4b5d-ba5c-a173d455e0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cb0f023-723e-4ac6-b6eb-8da5a30354ad', 'volume_name': 'volume-7cb0f023-723e-4ac6-b6eb-8da5a30354ad', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ff3a70-ce66-45a3-a49a-1733832da677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ff3a70-ce66-45a3-a49a-1733832da677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1087f7ca-1a26-416e-8e19-37333901c4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:54:25 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Volume 7cb0f023-723e-4ac6-b6eb-8da5a30354ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cb0f023-723e-4ac6-b6eb-8da5a30354ad', 'volume_size': 1}
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2087094231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb0f023-723e-4ac6-b6eb-8da5a30354ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e611d9257d84f7da02f5544e24e1e65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:54:25Z,use_quota=True,user_id='390e098a902246a9b54ba7b315189004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Creating volume 7cb0f023-723e-4ac6-b6eb-8da5a30354ad {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:54:25 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7cb0f023-723e-4ac6-b6eb-8da5a30354ad 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:25 devstack quobyte-client[82616]: System call of process 95249 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:54:25 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=96, name=volume-7cb0f023-723e-4ac6-b6eb-8da5a30354ad, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7cb0f023-723e-4ac6-b6eb-8da5a30354ad 1073741824" returned: 0 in 0.361s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7cb0f023-723e-4ac6-b6eb-8da5a30354ad {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7cb0f023-723e-4ac6-b6eb-8da5a30354ad" returned: 0 in 0.088s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] <== create_volume: return (543ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:54:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.556s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:54:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1087f7ca-1a26-416e-8e19-37333901c4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cb0f023-723e-4ac6-b6eb-8da5a30354ad', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:54:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b9dddb-1330-4954-a672-528fffa91892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:54:26 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Volume volume-7cb0f023-723e-4ac6-b6eb-8da5a30354ad (7cb0f023-723e-4ac6-b6eb-8da5a30354ad): created successfully
Sep 10 11:54:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b9dddb-1330-4954-a672-528fffa91892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:54:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Flow 'volume_create_manager' (05087743-35c6-4c64-9b70-dc32d13f7581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:54:26 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-032c2f88-5eeb-4bda-96dc-b25647649d43 tempest-AbsoluteLimitsTests-358876728 None] Created volume successfully.
Sep 10 11:54:27 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2613b962-facd-44c0-82d6-aa215a386794 tempest-AbsoluteLimitsTests-358876728 None] Acquiring lock "cinder-7cb0f023-723e-4ac6-b6eb-8da5a30354ad-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:54:27 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2613b962-facd-44c0-82d6-aa215a386794 tempest-AbsoluteLimitsTests-358876728 None] Lock "cinder-7cb0f023-723e-4ac6-b6eb-8da5a30354ad-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:54:27 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-2613b962-facd-44c0-82d6-aa215a386794 tempest-AbsoluteLimitsTests-358876728 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:54:27 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2613b962-facd-44c0-82d6-aa215a386794 tempest-AbsoluteLimitsTests-358876728 None] Acquiring lock "cinder-quobyte-7cb0f023-723e-4ac6-b6eb-8da5a30354ad" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:54:27 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2613b962-facd-44c0-82d6-aa215a386794 tempest-AbsoluteLimitsTests-358876728 None] Lock "cinder-quobyte-7cb0f023-723e-4ac6-b6eb-8da5a30354ad" acquired by "delete_volume" :: waited 0.011s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:54:27 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9c468d-bd6c-46fb-aa83-9a0b122efbf6]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:54:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2613b962-facd-44c0-82d6-aa215a386794 tempest-AbsoluteLimitsTests-358876728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7cb0f023-723e-4ac6-b6eb-8da5a30354ad {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2613b962-facd-44c0-82d6-aa215a386794 tempest-AbsoluteLimitsTests-358876728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7cb0f023-723e-4ac6-b6eb-8da5a30354ad" returned: 0 in 0.417s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2613b962-facd-44c0-82d6-aa215a386794 tempest-AbsoluteLimitsTests-358876728 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7cb0f023-723e-4ac6-b6eb-8da5a30354ad {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2613b962-facd-44c0-82d6-aa215a386794 tempest-AbsoluteLimitsTests-358876728 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7cb0f023-723e-4ac6-b6eb-8da5a30354ad" returned: 0 in 0.087s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:28 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2613b962-facd-44c0-82d6-aa215a386794 tempest-AbsoluteLimitsTests-358876728 None] Lock "cinder-quobyte-7cb0f023-723e-4ac6-b6eb-8da5a30354ad" released by "delete_volume" :: held 0.657s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:54:28 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-2613b962-facd-44c0-82d6-aa215a386794 tempest-AbsoluteLimitsTests-358876728 None] Created reservations ['df6e3cf1-7c74-454b-8c60-e32626470253', 'a36666c5-e1d9-4719-8bc4-03ca2b26eb5c', 'a8c02ec5-1bea-4588-a944-c4d5481a658b', '29d1f608-06eb-4083-a796-81a8bf833e6d'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:54:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2613b962-facd-44c0-82d6-aa215a386794 tempest-AbsoluteLimitsTests-358876728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:54:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2613b962-facd-44c0-82d6-aa215a386794 tempest-AbsoluteLimitsTests-358876728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:54:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2613b962-facd-44c0-82d6-aa215a386794 tempest-AbsoluteLimitsTests-358876728 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:54:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2613b962-facd-44c0-82d6-aa215a386794 tempest-AbsoluteLimitsTests-358876728 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:54:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2613b962-facd-44c0-82d6-aa215a386794 tempest-AbsoluteLimitsTests-358876728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:54:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2613b962-facd-44c0-82d6-aa215a386794 tempest-AbsoluteLimitsTests-358876728 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2613b962-facd-44c0-82d6-aa215a386794 tempest-AbsoluteLimitsTests-358876728 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.092s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:28 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-2613b962-facd-44c0-82d6-aa215a386794 tempest-AbsoluteLimitsTests-358876728 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:54:28 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-2613b962-facd-44c0-82d6-aa215a386794 tempest-AbsoluteLimitsTests-358876728 None] Deleted volume successfully.
Sep 10 11:54:28 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2613b962-facd-44c0-82d6-aa215a386794 tempest-AbsoluteLimitsTests-358876728 None] Lock "cinder-7cb0f023-723e-4ac6-b6eb-8da5a30354ad-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:54:34 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:54:34 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:54:34 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Flow 'volume_create_manager' (b027b2d5-44d5-4d9d-94a4-fc1856a4729a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:54:34 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767bc1cd-d75d-4110-af44-6cbc83d188a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:54:34 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767bc1cd-d75d-4110-af44-6cbc83d188a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1967399282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663f56d7-9a95-4fb1-8145-319746318f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc0431054d314e4f8005ddf5eae3593f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:54:34Z,use_quota=True,user_id='f83d86fce0a74e5d9ed9a4d7a283f009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:54:34 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de410cf8-f1e3-4147-b47d-3cecf3f2f966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:54:34 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de410cf8-f1e3-4147-b47d-3cecf3f2f966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:54:34 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21bf287c-7fc3-4123-a6d7-502058065ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:54:34 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21bf287c-7fc3-4123-a6d7-502058065ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '663f56d7-9a95-4fb1-8145-319746318f6a', 'volume_name': 'volume-663f56d7-9a95-4fb1-8145-319746318f6a', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:54:34 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576a9311-a88a-4ccf-a7e9-92ea0c3d2be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:54:34 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576a9311-a88a-4ccf-a7e9-92ea0c3d2be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:54:34 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a3fc57e-1edb-47dc-9093-3f18fe21d588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:54:34 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Volume 663f56d7-9a95-4fb1-8145-319746318f6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-663f56d7-9a95-4fb1-8145-319746318f6a', 'volume_size': 1}
Sep 10 11:54:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:54:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:54:34 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1967399282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663f56d7-9a95-4fb1-8145-319746318f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc0431054d314e4f8005ddf5eae3593f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:54:34Z,use_quota=True,user_id='f83d86fce0a74e5d9ed9a4d7a283f009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:54:34 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Creating volume 663f56d7-9a95-4fb1-8145-319746318f6a {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:54:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:54:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:54:34 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:54:34 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:54:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:54:34 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:54:34 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:54:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:34 devstack quobyte-client[82616]: System call of process 95265 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:54:34 devstack quobyte-client[82616]: System call of process 95265 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:54:34 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=97, name=volume-663f56d7-9a95-4fb1-8145-319746318f6a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:54:34 devstack quobyte-client[82616]: System call of process 95265 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:54:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a 1073741824" returned: 0 in 0.349s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a" returned: 0 in 0.088s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:35 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] <== create_volume: return (502ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:54:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.516s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:54:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a3fc57e-1edb-47dc-9093-3f18fe21d588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-663f56d7-9a95-4fb1-8145-319746318f6a', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:54:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e4aa7e5-3776-4005-9604-eedbf44318a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:54:35 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Volume volume-663f56d7-9a95-4fb1-8145-319746318f6a (663f56d7-9a95-4fb1-8145-319746318f6a): created successfully
Sep 10 11:54:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e4aa7e5-3776-4005-9604-eedbf44318a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:54:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Flow 'volume_create_manager' (b027b2d5-44d5-4d9d-94a4-fc1856a4729a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:54:35 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-10d1c511-b9e7-4124-aca7-eb27cd1ed1c4 tempest-VolumesDeleteCascade-1601729419 None] Created volume successfully.
Sep 10 11:54:37 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-a7ff5de5-9317-4fcd-aedf-faca830c3362 tempest-VolumesDeleteCascade-1601729419 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:54:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a7ff5de5-9317-4fcd-aedf-faca830c3362 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:54:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a7ff5de5-9317-4fcd-aedf-faca830c3362 tempest-VolumesDeleteCascade-1601729419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:54:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-a7ff5de5-9317-4fcd-aedf-faca830c3362 tempest-VolumesDeleteCascade-1601729419 None] Creating offline snapshot aeed56a4-08cc-47fe-9182-51f92872e27f of volume 663f56d7-9a95-4fb1-8145-319746318f6a {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 11:54:37 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b0889a-43ff-4777-9e9f-3f02324a5a4f]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:54:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a7ff5de5-9317-4fcd-aedf-faca830c3362 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:37 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-0c83ba08-f295-49ae-ab48-1256bdee75c8 req-e5eaa6ba-78e6-47d7-8b04-359c13e3e9bb tempest-TestInstancesWithCinderVolumes-278728036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:54:37 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-0c83ba08-f295-49ae-ab48-1256bdee75c8 req-e5eaa6ba-78e6-47d7-8b04-359c13e3e9bb tempest-TestInstancesWithCinderVolumes-278728036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:54:37 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-0c83ba08-f295-49ae-ab48-1256bdee75c8 req-e5eaa6ba-78e6-47d7-8b04-359c13e3e9bb tempest-TestInstancesWithCinderVolumes-278728036 None] Terminate volume connection completed successfully.
Sep 10 11:54:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-0c83ba08-f295-49ae-ab48-1256bdee75c8 req-e5eaa6ba-78e6-47d7-8b04-359c13e3e9bb tempest-TestInstancesWithCinderVolumes-278728036 None] Deleting attachment 03a90cd2-cd7d-46cb-b1b7-63221e23419e. {{(pid=82594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 11:54:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a7ff5de5-9317-4fcd-aedf-faca830c3362 tempest-VolumesDeleteCascade-1601729419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a" returned: 0 in 0.571s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a7ff5de5-9317-4fcd-aedf-faca830c3362 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:37 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=98, name=volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:54:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a7ff5de5-9317-4fcd-aedf-faca830c3362 tempest-VolumesDeleteCascade-1601729419 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f 1G" returned: 0 in 0.294s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a7ff5de5-9317-4fcd-aedf-faca830c3362 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): qemu-img rebase -u -b volume-663f56d7-9a95-4fb1-8145-319746318f6a -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:38 devstack quobyte-client[82616]: System call of process 95278 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:54:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a7ff5de5-9317-4fcd-aedf-faca830c3362 tempest-VolumesDeleteCascade-1601729419 None] CMD "qemu-img rebase -u -b volume-663f56d7-9a95-4fb1-8145-319746318f6a -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f" returned: 0 in 0.166s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:38 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-a7ff5de5-9317-4fcd-aedf-faca830c3362 tempest-VolumesDeleteCascade-1601729419 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:54:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a7ff5de5-9317-4fcd-aedf-faca830c3362 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a7ff5de5-9317-4fcd-aedf-faca830c3362 tempest-VolumesDeleteCascade-1601729419 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f" returned: 0 in 0.084s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:38 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-a7ff5de5-9317-4fcd-aedf-faca830c3362 tempest-VolumesDeleteCascade-1601729419 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 11:54:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a7ff5de5-9317-4fcd-aedf-faca830c3362 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a7ff5de5-9317-4fcd-aedf-faca830c3362 tempest-VolumesDeleteCascade-1601729419 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f" returned: 0 in 0.096s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a7ff5de5-9317-4fcd-aedf-faca830c3362 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a7ff5de5-9317-4fcd-aedf-faca830c3362 tempest-VolumesDeleteCascade-1601729419 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.info" returned: 0 in 0.096s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:38 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-a7ff5de5-9317-4fcd-aedf-faca830c3362 tempest-VolumesDeleteCascade-1601729419 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.info is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:54:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a7ff5de5-9317-4fcd-aedf-faca830c3362 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a7ff5de5-9317-4fcd-aedf-faca830c3362 tempest-VolumesDeleteCascade-1601729419 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.info" returned: 0 in 0.089s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a7ff5de5-9317-4fcd-aedf-faca830c3362 tempest-VolumesDeleteCascade-1601729419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.742s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:54:39 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-4f00763b-0674-4802-b272-36e541486ba0 tempest-TestInstancesWithCinderVolumes-278728036 None] Acquiring lock "cinder-4bec92ae-9fe3-4756-84a6-4a50f198f2b1-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:54:39 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-4f00763b-0674-4802-b272-36e541486ba0 tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "cinder-4bec92ae-9fe3-4756-84a6-4a50f198f2b1-delete_volume" acquired by "delete_volume" :: waited 0.169s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:54:39 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-a7ff5de5-9317-4fcd-aedf-faca830c3362 tempest-VolumesDeleteCascade-1601729419 None] Create snapshot completed successfully
Sep 10 11:54:39 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-4f00763b-0674-4802-b272-36e541486ba0 tempest-TestInstancesWithCinderVolumes-278728036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:54:39 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-4f00763b-0674-4802-b272-36e541486ba0 tempest-TestInstancesWithCinderVolumes-278728036 None] Acquiring lock "cinder-quobyte-4bec92ae-9fe3-4756-84a6-4a50f198f2b1" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:54:39 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-4f00763b-0674-4802-b272-36e541486ba0 tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "cinder-quobyte-4bec92ae-9fe3-4756-84a6-4a50f198f2b1" acquired by "delete_volume" :: waited 0.017s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:54:39 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d224535-3d44-4fdc-a55f-49f0de6e1fbc]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:54:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4f00763b-0674-4802-b272-36e541486ba0 tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4bec92ae-9fe3-4756-84a6-4a50f198f2b1 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:39 devstack quobyte-client[82616]: System call of process 95289 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:54:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4f00763b-0674-4802-b272-36e541486ba0 tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4bec92ae-9fe3-4756-84a6-4a50f198f2b1" returned: 0 in 0.509s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4f00763b-0674-4802-b272-36e541486ba0 tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4bec92ae-9fe3-4756-84a6-4a50f198f2b1 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4f00763b-0674-4802-b272-36e541486ba0 tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4bec92ae-9fe3-4756-84a6-4a50f198f2b1" returned: 0 in 0.105s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:40 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-4f00763b-0674-4802-b272-36e541486ba0 tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "cinder-quobyte-4bec92ae-9fe3-4756-84a6-4a50f198f2b1" released by "delete_volume" :: held 0.809s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:54:40 devstack cinder-volume[82594]: WARNING cinder.quota [None req-4f00763b-0674-4802-b272-36e541486ba0 tempest-TestInstancesWithCinderVolumes-278728036 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1667876116-1371260118 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1667876116-1371260118, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:54:40 devstack cinder-volume[82594]: WARNING cinder.quota [None req-4f00763b-0674-4802-b272-36e541486ba0 tempest-TestInstancesWithCinderVolumes-278728036 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1667876116-1371260118 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1667876116-1371260118, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:54:40 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-4f00763b-0674-4802-b272-36e541486ba0 tempest-TestInstancesWithCinderVolumes-278728036 None] Created reservations ['a8c6066f-db86-492e-91c2-22d1cc82e9a2', 'd702307b-fb26-43de-be96-34f7a44a7e3f', '305f87e5-fd3d-4658-8a5c-6f50a11c3912', '66a7c6f1-44d6-40fb-9679-4b92ec07a76a'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:54:40 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-de657e89-fa0f-4cd0-a313-42d8d3429613 tempest-VolumesDeleteCascade-1601729419 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:54:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-de657e89-fa0f-4cd0-a313-42d8d3429613 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:54:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-de657e89-fa0f-4cd0-a313-42d8d3429613 tempest-VolumesDeleteCascade-1601729419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:54:40 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-de657e89-fa0f-4cd0-a313-42d8d3429613 tempest-VolumesDeleteCascade-1601729419 None] Creating offline snapshot 41c05561-03dc-4b88-add2-52eda9d85977 of volume 663f56d7-9a95-4fb1-8145-319746318f6a {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 11:54:40 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebab1f8-6802-44ee-98e6-94c2f884b1d2]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:54:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-de657e89-fa0f-4cd0-a313-42d8d3429613 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:41 devstack quobyte-client[82616]: System call of process 95294 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:54:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4f00763b-0674-4802-b272-36e541486ba0 tempest-TestInstancesWithCinderVolumes-278728036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:54:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4f00763b-0674-4802-b272-36e541486ba0 tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:54:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4f00763b-0674-4802-b272-36e541486ba0 tempest-TestInstancesWithCinderVolumes-278728036 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:54:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4f00763b-0674-4802-b272-36e541486ba0 tempest-TestInstancesWithCinderVolumes-278728036 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:54:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4f00763b-0674-4802-b272-36e541486ba0 tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:54:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4f00763b-0674-4802-b272-36e541486ba0 tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-de657e89-fa0f-4cd0-a313-42d8d3429613 tempest-VolumesDeleteCascade-1601729419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f" returned: 0 in 0.746s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-de657e89-fa0f-4cd0-a313-42d8d3429613 tempest-VolumesDeleteCascade-1601729419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-663f56d7-9a95-4fb1-8145-319746318f6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:54:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-de657e89-fa0f-4cd0-a313-42d8d3429613 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.41c05561-03dc-4b88-add2-52eda9d85977 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4f00763b-0674-4802-b272-36e541486ba0 tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.299s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:41 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-4f00763b-0674-4802-b272-36e541486ba0 tempest-TestInstancesWithCinderVolumes-278728036 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:54:41 devstack quobyte-client[82616]: System call of process 95300 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:54:41 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-4f00763b-0674-4802-b272-36e541486ba0 tempest-TestInstancesWithCinderVolumes-278728036 None] Deleted volume successfully.
Sep 10 11:54:41 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=100, name=volume-663f56d7-9a95-4fb1-8145-319746318f6a.41c05561-03dc-4b88-add2-52eda9d85977, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:54:41 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-4f00763b-0674-4802-b272-36e541486ba0 tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "cinder-4bec92ae-9fe3-4756-84a6-4a50f198f2b1-delete_volume" released by "delete_volume" :: held 2.781s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:54:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-de657e89-fa0f-4cd0-a313-42d8d3429613 tempest-VolumesDeleteCascade-1601729419 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.41c05561-03dc-4b88-add2-52eda9d85977 1G" returned: 0 in 0.493s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-de657e89-fa0f-4cd0-a313-42d8d3429613 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): qemu-img rebase -u -b volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.41c05561-03dc-4b88-add2-52eda9d85977 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:42 devstack quobyte-client[82616]: System call of process 95305 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:54:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-de657e89-fa0f-4cd0-a313-42d8d3429613 tempest-VolumesDeleteCascade-1601729419 None] CMD "qemu-img rebase -u -b volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.41c05561-03dc-4b88-add2-52eda9d85977" returned: 0 in 0.161s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:42 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-de657e89-fa0f-4cd0-a313-42d8d3429613 tempest-VolumesDeleteCascade-1601729419 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.41c05561-03dc-4b88-add2-52eda9d85977 is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:54:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-de657e89-fa0f-4cd0-a313-42d8d3429613 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.41c05561-03dc-4b88-add2-52eda9d85977 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-de657e89-fa0f-4cd0-a313-42d8d3429613 tempest-VolumesDeleteCascade-1601729419 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.41c05561-03dc-4b88-add2-52eda9d85977" returned: 0 in 0.097s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:42 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-de657e89-fa0f-4cd0-a313-42d8d3429613 tempest-VolumesDeleteCascade-1601729419 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 11:54:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-de657e89-fa0f-4cd0-a313-42d8d3429613 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.41c05561-03dc-4b88-add2-52eda9d85977 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-de657e89-fa0f-4cd0-a313-42d8d3429613 tempest-VolumesDeleteCascade-1601729419 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.41c05561-03dc-4b88-add2-52eda9d85977" returned: 0 in 0.135s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-de657e89-fa0f-4cd0-a313-42d8d3429613 tempest-VolumesDeleteCascade-1601729419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.923s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:54:42 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-de657e89-fa0f-4cd0-a313-42d8d3429613 tempest-VolumesDeleteCascade-1601729419 None] Create snapshot completed successfully
Sep 10 11:54:43 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "cinder-663f56d7-9a95-4fb1-8145-319746318f6a-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:54:44 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-663f56d7-9a95-4fb1-8145-319746318f6a-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:54:44 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:54:44 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Performing cascade delete. {{(pid=82594) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 10 11:54:44 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "cinder-41c05561-03dc-4b88-add2-52eda9d85977-delete_snapshot" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:54:44 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-41c05561-03dc-4b88-add2-52eda9d85977-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:54:44 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:54:44 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "cinder-quobyte-663f56d7-9a95-4fb1-8145-319746318f6a" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:54:44 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-quobyte-663f56d7-9a95-4fb1-8145-319746318f6a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:54:44 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "cinder-quobyte-41c05561-03dc-4b88-add2-52eda9d85977" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:54:44 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-quobyte-41c05561-03dc-4b88-add2-52eda9d85977" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:54:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Deleting offline snapshot 41c05561-03dc-4b88-add2-52eda9d85977 of volume 663f56d7-9a95-4fb1-8145-319746318f6a {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 11:54:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] snapshot_file for this snap is: volume-663f56d7-9a95-4fb1-8145-319746318f6a.41c05561-03dc-4b88-add2-52eda9d85977 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 11:54:44 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3d4c6c-98b8-4bdc-97ac-a934b46d7f7c]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:54:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.41c05561-03dc-4b88-add2-52eda9d85977 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:44 devstack quobyte-client[82616]: System call of process 95321 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:54:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.41c05561-03dc-4b88-add2-52eda9d85977" returned: 0 in 0.478s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-663f56d7-9a95-4fb1-8145-319746318f6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:54:44 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc07c70a-922d-4552-a6d2-235465d7e52f]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:54:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f" returned: 0 in 0.480s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:45 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-663f56d7-9a95-4fb1-8145-319746318f6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:54:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.41c05561-03dc-4b88-add2-52eda9d85977 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.41c05561-03dc-4b88-add2-52eda9d85977" returned: 0 in 0.336s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.41c05561-03dc-4b88-add2-52eda9d85977 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.41c05561-03dc-4b88-add2-52eda9d85977" returned: 0 in 0.116s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:46 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-quobyte-41c05561-03dc-4b88-add2-52eda9d85977" released by "_delete_snapshot" :: held 1.760s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:54:46 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-quobyte-663f56d7-9a95-4fb1-8145-319746318f6a" released by "delete_snapshot" :: held 1.793s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:54:46 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Created reservations ['8bc55155-f184-47c3-a02e-643ed0ab8e59', '4bbd31c9-7e50-4460-abcf-23fde40fd319', 'fca43bff-5d32-4e06-b0a5-481a6aac0182', '9fc4895a-436d-48da-85a8-3e2f72b8b49a'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:54:46 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Delete snapshot completed successfully.
Sep 10 11:54:46 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-41c05561-03dc-4b88-add2-52eda9d85977-delete_snapshot" released by "delete_snapshot" :: held 2.406s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:54:46 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "cinder-aeed56a4-08cc-47fe-9182-51f92872e27f-delete_snapshot" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:54:46 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-aeed56a4-08cc-47fe-9182-51f92872e27f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:54:46 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:54:46 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "cinder-quobyte-663f56d7-9a95-4fb1-8145-319746318f6a" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:54:46 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-quobyte-663f56d7-9a95-4fb1-8145-319746318f6a" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:54:46 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "cinder-quobyte-aeed56a4-08cc-47fe-9182-51f92872e27f" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:54:46 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-quobyte-aeed56a4-08cc-47fe-9182-51f92872e27f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:54:46 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Deleting offline snapshot aeed56a4-08cc-47fe-9182-51f92872e27f of volume 663f56d7-9a95-4fb1-8145-319746318f6a {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 11:54:46 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] snapshot_file for this snap is: volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 11:54:46 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[50abdeac-ac4c-4cce-b1fb-4c7fab744cbd]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:54:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:47 devstack quobyte-client[82616]: System call of process 95337 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:54:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f" returned: 0 in 0.438s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:47 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-663f56d7-9a95-4fb1-8145-319746318f6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:54:47 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5d7958-c8d3-4158-90aa-2334a6ed6026]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:54:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a" returned: 0 in 0.450s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f" returned: 0 in 0.294s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a.aeed56a4-08cc-47fe-9182-51f92872e27f" returned: 0 in 0.109s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:48 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-quobyte-aeed56a4-08cc-47fe-9182-51f92872e27f" released by "_delete_snapshot" :: held 1.715s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:54:48 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-quobyte-663f56d7-9a95-4fb1-8145-319746318f6a" released by "delete_snapshot" :: held 1.742s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:54:48 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Created reservations ['ad7d95f9-1870-4364-9f20-730d89050c33', '2cc2145f-5ed1-4920-9851-d8890d3c5028', '368d8bb2-c8f9-4501-b53e-dad2a713188a', '677c5184-d9df-4b0f-9e85-8bba83dedbde'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:54:48 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Delete snapshot completed successfully.
Sep 10 11:54:48 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-aeed56a4-08cc-47fe-9182-51f92872e27f-delete_snapshot" released by "delete_snapshot" :: held 2.330s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:54:48 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Snapshots deleted, issuing volume delete {{(pid=82594) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 10 11:54:48 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "cinder-quobyte-663f56d7-9a95-4fb1-8145-319746318f6a" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:54:49 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-quobyte-663f56d7-9a95-4fb1-8145-319746318f6a" acquired by "delete_volume" :: waited 0.027s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:54:49 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dc039a-4ee7-4593-a3af-3d0a04fddb47]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:54:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a" returned: 0 in 0.421s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-663f56d7-9a95-4fb1-8145-319746318f6a" returned: 0 in 0.104s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:49 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-quobyte-663f56d7-9a95-4fb1-8145-319746318f6a" released by "delete_volume" :: held 0.712s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:54:49 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Created reservations ['2bfb2809-ed3b-40d3-b14d-fe7d30a6cf11', '7079b2c0-433e-4d3f-9d2e-ed00b2c0c0b3', 'f1a1468f-355b-423a-be35-6bbec590a887', '6c5ae702-f0fd-402c-8138-9510f5672ec2'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:54:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:54:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:54:50 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:54:50 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:54:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:54:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.100s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:50 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:54:50 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Deleted volume successfully.
Sep 10 11:54:50 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7a3a82f8-3d1e-4cc6-9df9-72bfed736bd5 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-663f56d7-9a95-4fb1-8145-319746318f6a-delete_volume" released by "delete_volume" :: held 6.542s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:54:51 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:54:51 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:54:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Flow 'volume_create_manager' (ee7c2c3d-1d2a-45a5-8602-1de1b7136010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:54:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16aa4d5-99c6-4fdb-a7aa-18db92f1fb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:54:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16aa4d5-99c6-4fdb-a7aa-18db92f1fb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1715481438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d080f2c-ec34-42e1-aac2-7040a974e691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc0431054d314e4f8005ddf5eae3593f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:54:51Z,use_quota=True,user_id='f83d86fce0a74e5d9ed9a4d7a283f009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:54:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (885bc67c-86ba-4b20-a1cc-367bfadd7c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:54:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (885bc67c-86ba-4b20-a1cc-367bfadd7c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:54:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9229af5-f464-438e-9758-dab9a6eca5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:54:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9229af5-f464-438e-9758-dab9a6eca5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d080f2c-ec34-42e1-aac2-7040a974e691', 'volume_name': 'volume-2d080f2c-ec34-42e1-aac2-7040a974e691', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:54:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4434d33b-89f9-4e63-a60a-0d90b543f3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:54:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4434d33b-89f9-4e63-a60a-0d90b543f3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:54:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298b7c12-04a7-454a-ad6e-c5468bedc446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:54:51 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Volume 2d080f2c-ec34-42e1-aac2-7040a974e691: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d080f2c-ec34-42e1-aac2-7040a974e691', 'volume_size': 1}
Sep 10 11:54:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:54:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:54:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1715481438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d080f2c-ec34-42e1-aac2-7040a974e691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc0431054d314e4f8005ddf5eae3593f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:54:51Z,use_quota=True,user_id='f83d86fce0a74e5d9ed9a4d7a283f009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:54:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Creating volume 2d080f2c-ec34-42e1-aac2-7040a974e691 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:54:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:54:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:54:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:54:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:54:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:54:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:54:51 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:54:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:51 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=101, name=volume-2d080f2c-ec34-42e1-aac2-7040a974e691, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:54:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691 1073741824" returned: 0 in 0.342s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691" returned: 0 in 0.093s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:52 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] <== create_volume: return (532ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:54:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.545s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:54:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298b7c12-04a7-454a-ad6e-c5468bedc446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d080f2c-ec34-42e1-aac2-7040a974e691', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:54:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08dda384-ece5-46bb-811f-295fe88b46f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:54:52 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Volume volume-2d080f2c-ec34-42e1-aac2-7040a974e691 (2d080f2c-ec34-42e1-aac2-7040a974e691): created successfully
Sep 10 11:54:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08dda384-ece5-46bb-811f-295fe88b46f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:54:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Flow 'volume_create_manager' (ee7c2c3d-1d2a-45a5-8602-1de1b7136010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:54:52 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-630dfdf4-8311-4581-902d-ba31b2425902 tempest-VolumesDeleteCascade-1601729419 None] Created volume successfully.
Sep 10 11:54:54 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-bf21c7aa-675c-42e9-8125-b7eca987a274 tempest-VolumesDeleteCascade-1601729419 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:54:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bf21c7aa-675c-42e9-8125-b7eca987a274 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:54:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bf21c7aa-675c-42e9-8125-b7eca987a274 tempest-VolumesDeleteCascade-1601729419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:54:54 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-bf21c7aa-675c-42e9-8125-b7eca987a274 tempest-VolumesDeleteCascade-1601729419 None] Creating offline snapshot 2289f4be-54ef-4af9-9df6-346e43809c6e of volume 2d080f2c-ec34-42e1-aac2-7040a974e691 {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 11:54:54 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c1716c-edcb-4a55-8ab6-360c767f6dd4]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:54:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bf21c7aa-675c-42e9-8125-b7eca987a274 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bf21c7aa-675c-42e9-8125-b7eca987a274 tempest-VolumesDeleteCascade-1601729419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691" returned: 0 in 0.467s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bf21c7aa-675c-42e9-8125-b7eca987a274 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691.2289f4be-54ef-4af9-9df6-346e43809c6e 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:55 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=102, name=volume-2d080f2c-ec34-42e1-aac2-7040a974e691.2289f4be-54ef-4af9-9df6-346e43809c6e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:54:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bf21c7aa-675c-42e9-8125-b7eca987a274 tempest-VolumesDeleteCascade-1601729419 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691.2289f4be-54ef-4af9-9df6-346e43809c6e 1G" returned: 0 in 0.245s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bf21c7aa-675c-42e9-8125-b7eca987a274 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2d080f2c-ec34-42e1-aac2-7040a974e691 -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691.2289f4be-54ef-4af9-9df6-346e43809c6e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bf21c7aa-675c-42e9-8125-b7eca987a274 tempest-VolumesDeleteCascade-1601729419 None] CMD "qemu-img rebase -u -b volume-2d080f2c-ec34-42e1-aac2-7040a974e691 -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691.2289f4be-54ef-4af9-9df6-346e43809c6e" returned: 0 in 0.137s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:55 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-bf21c7aa-675c-42e9-8125-b7eca987a274 tempest-VolumesDeleteCascade-1601729419 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691.2289f4be-54ef-4af9-9df6-346e43809c6e is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:54:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bf21c7aa-675c-42e9-8125-b7eca987a274 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691.2289f4be-54ef-4af9-9df6-346e43809c6e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bf21c7aa-675c-42e9-8125-b7eca987a274 tempest-VolumesDeleteCascade-1601729419 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691.2289f4be-54ef-4af9-9df6-346e43809c6e" returned: 0 in 0.087s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:55 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-bf21c7aa-675c-42e9-8125-b7eca987a274 tempest-VolumesDeleteCascade-1601729419 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691 -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 11:54:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bf21c7aa-675c-42e9-8125-b7eca987a274 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691.2289f4be-54ef-4af9-9df6-346e43809c6e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bf21c7aa-675c-42e9-8125-b7eca987a274 tempest-VolumesDeleteCascade-1601729419 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691.2289f4be-54ef-4af9-9df6-346e43809c6e" returned: 0 in 0.109s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bf21c7aa-675c-42e9-8125-b7eca987a274 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bf21c7aa-675c-42e9-8125-b7eca987a274 tempest-VolumesDeleteCascade-1601729419 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691.info" returned: 0 in 0.110s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:55 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-bf21c7aa-675c-42e9-8125-b7eca987a274 tempest-VolumesDeleteCascade-1601729419 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691.info is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:54:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bf21c7aa-675c-42e9-8125-b7eca987a274 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bf21c7aa-675c-42e9-8125-b7eca987a274 tempest-VolumesDeleteCascade-1601729419 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691.info" returned: 0 in 0.084s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bf21c7aa-675c-42e9-8125-b7eca987a274 tempest-VolumesDeleteCascade-1601729419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.562s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:54:56 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-bf21c7aa-675c-42e9-8125-b7eca987a274 tempest-VolumesDeleteCascade-1601729419 None] Create snapshot completed successfully
Sep 10 11:54:57 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Flow 'volume_create_manager' (ebed19f5-11ff-42d2-bd27-070c7aa6896d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8258e988-e9b1-4a64-ab24-b1a591fb54da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8258e988-e9b1-4a64-ab24-b1a591fb54da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-426644857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=711447ec-a762-489c-8893-00c038965e9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc0431054d314e4f8005ddf5eae3593f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2289f4be-54ef-4af9-9df6-346e43809c6e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:54:57Z,use_quota=True,user_id='f83d86fce0a74e5d9ed9a4d7a283f009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e489c1b-97ab-4f7d-9fda-be03e0686f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e489c1b-97ab-4f7d-9fda-be03e0686f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (470f53fa-9c81-4850-9eb0-f211e9b695a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (470f53fa-9c81-4850-9eb0-f211e9b695a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '711447ec-a762-489c-8893-00c038965e9a', 'volume_name': 'volume-711447ec-a762-489c-8893-00c038965e9a', 'volume_size': 1, 'snapshot_id': '2289f4be-54ef-4af9-9df6-346e43809c6e'}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (097a0591-d14b-4a0f-9922-fb5e80a6b16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (097a0591-d14b-4a0f-9922-fb5e80a6b16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc33fa4-98cb-455d-a1df-5252703866bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:54:57 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Volume 711447ec-a762-489c-8893-00c038965e9a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-711447ec-a762-489c-8893-00c038965e9a', 'volume_size': 1, 'snapshot_id': '2289f4be-54ef-4af9-9df6-346e43809c6e'}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "cinder-quobyte-2289f4be-54ef-4af9-9df6-346e43809c6e-711447ec-a762-489c-8893-00c038965e9a" by "_create_volume_from_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-quobyte-2289f4be-54ef-4af9-9df6-346e43809c6e-711447ec-a762-489c-8893-00c038965e9a" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Creating volume 711447ec-a762-489c-8893-00c038965e9a from snapshot 2289f4be-54ef-4af9-9df6-346e43809c6e {{(pid=82594) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "cinder-quobyte-711447ec-a762-489c-8893-00c038965e9a" by "_copy_volume_from_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-quobyte-711447ec-a762-489c-8893-00c038965e9a" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] snapshot: 2289f4be-54ef-4af9-9df6-346e43809c6e, volume: 711447ec-a762-489c-8893-00c038965e9a,  {{(pid=82594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d253d8a1-1ea7-4c21-be03-10f275e37ad9]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:54:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691.2289f4be-54ef-4af9-9df6-346e43809c6e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691.2289f4be-54ef-4af9-9df6-346e43809c6e" returned: 0 in 0.419s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:58 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d080f2c-ec34-42e1-aac2-7040a974e691(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:54:58 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691 {{(pid=82594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 10 11:54:58 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Creating direct copy from snapshot {{(pid=82594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 10 11:54:58 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e033975-cf51-4d82-9784-931a500ec32c]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:54:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691" returned: 0 in 0.446s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:54:58 devstack cinder-volume[82594]: DEBUG cinder.utils [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-711447ec-a762-489c-8893-00c038965e9a not found in is_blk_device check {{(pid=82594) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 10 11:54:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-711447ec-a762-489c-8893-00c038965e9a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:54:58 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=104, name=volume-711447ec-a762-489c-8893-00c038965e9a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:55:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-711447ec-a762-489c-8893-00c038965e9a" returned: 0 in 7.513s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:06 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[43aa43e5-f4d2-4327-8fef-a4fcd2449fbc]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:55:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691" returned: 0 in 0.544s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:06 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Image conversion details: src /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691, size 1024.00 MB, duration 7.53 sec, destination /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-711447ec-a762-489c-8893-00c038965e9a {{(pid=82594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 11:55:06 devstack cinder-volume[82594]: INFO cinder.image.image_utils [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Converted 1024.00 MB image at 135.93 MB/s
Sep 10 11:55:06 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-711447ec-a762-489c-8893-00c038965e9a is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:55:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-711447ec-a762-489c-8893-00c038965e9a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-711447ec-a762-489c-8893-00c038965e9a" returned: 0 in 0.089s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:06 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-quobyte-711447ec-a762-489c-8893-00c038965e9a" released by "_copy_volume_from_snapshot" :: held 9.381s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:55:06 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-quobyte-2289f4be-54ef-4af9-9df6-346e43809c6e-711447ec-a762-489c-8893-00c038965e9a" released by "_create_volume_from_snapshot" :: held 9.419s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:55:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.436s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:55:07 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc33fa4-98cb-455d-a1df-5252703866bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-711447ec-a762-489c-8893-00c038965e9a', 'volume_size': 1, 'snapshot_id': '2289f4be-54ef-4af9-9df6-346e43809c6e'}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:55:07 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14fc9c3-73b8-4818-92da-233862e86062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:55:07 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Volume volume-711447ec-a762-489c-8893-00c038965e9a (711447ec-a762-489c-8893-00c038965e9a): created successfully
Sep 10 11:55:07 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14fc9c3-73b8-4818-92da-233862e86062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:55:07 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Flow 'volume_create_manager' (ebed19f5-11ff-42d2-bd27-070c7aa6896d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:55:07 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-d1b61c6b-2c39-47b7-b7dd-38ed24582516 tempest-VolumesDeleteCascade-1601729419 None] Created volume successfully.
Sep 10 11:55:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "cinder-2d080f2c-ec34-42e1-aac2-7040a974e691-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:55:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-2d080f2c-ec34-42e1-aac2-7040a974e691-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:55:08 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:55:08 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Performing cascade delete. {{(pid=82594) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 10 11:55:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "cinder-2289f4be-54ef-4af9-9df6-346e43809c6e-delete_snapshot" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:55:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-2289f4be-54ef-4af9-9df6-346e43809c6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:55:08 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:55:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "cinder-quobyte-2d080f2c-ec34-42e1-aac2-7040a974e691" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:55:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-quobyte-2d080f2c-ec34-42e1-aac2-7040a974e691" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:55:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "cinder-quobyte-2289f4be-54ef-4af9-9df6-346e43809c6e" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:55:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-quobyte-2289f4be-54ef-4af9-9df6-346e43809c6e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:55:08 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Deleting offline snapshot 2289f4be-54ef-4af9-9df6-346e43809c6e of volume 2d080f2c-ec34-42e1-aac2-7040a974e691 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 11:55:08 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] snapshot_file for this snap is: volume-2d080f2c-ec34-42e1-aac2-7040a974e691.2289f4be-54ef-4af9-9df6-346e43809c6e {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 11:55:08 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[913a8b3e-ab60-473e-a5f8-6fddd51819e9]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:55:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691.2289f4be-54ef-4af9-9df6-346e43809c6e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691.2289f4be-54ef-4af9-9df6-346e43809c6e" returned: 0 in 0.493s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:09 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-ce080307-937a-4d5a-953d-33be9720a1c5 req-ec364c01-47c6-4bf0-8346-f060b9dd8bf9 tempest-TestInstancesWithCinderVolumes-278728036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:55:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d080f2c-ec34-42e1-aac2-7040a974e691(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:55:09 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da6002e-e076-49c5-8ab7-a3048096dfd5]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:55:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:09 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-ce080307-937a-4d5a-953d-33be9720a1c5 req-ec364c01-47c6-4bf0-8346-f060b9dd8bf9 tempest-TestInstancesWithCinderVolumes-278728036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:55:09 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-ce080307-937a-4d5a-953d-33be9720a1c5 req-ec364c01-47c6-4bf0-8346-f060b9dd8bf9 tempest-TestInstancesWithCinderVolumes-278728036 None] Terminate volume connection completed successfully.
Sep 10 11:55:09 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-ce080307-937a-4d5a-953d-33be9720a1c5 req-ec364c01-47c6-4bf0-8346-f060b9dd8bf9 tempest-TestInstancesWithCinderVolumes-278728036 None] Deleting attachment 222e82b7-2fa6-432f-a2a5-cdd7c8a00845. {{(pid=82594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 11:55:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691" returned: 0 in 0.538s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691.2289f4be-54ef-4af9-9df6-346e43809c6e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:10 devstack quobyte-client[82616]: System call of process 95436 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:55:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691.2289f4be-54ef-4af9-9df6-346e43809c6e" returned: 0 in 0.206s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691.2289f4be-54ef-4af9-9df6-346e43809c6e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691.2289f4be-54ef-4af9-9df6-346e43809c6e" returned: 0 in 0.140s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:10 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-quobyte-2289f4be-54ef-4af9-9df6-346e43809c6e" released by "_delete_snapshot" :: held 1.865s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:55:10 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-quobyte-2d080f2c-ec34-42e1-aac2-7040a974e691" released by "delete_snapshot" :: held 1.894s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:55:10 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Created reservations ['164b1db7-1d69-4de1-a67d-5f002a8bf7e3', 'a8241cf9-eb13-4b8c-8f05-03d8cef6d782', '42684e1e-33d2-4e62-9cbd-72fbd57e655b', '9f76b2a6-9fd6-4680-952e-3a1102f2bf16'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:55:10 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Delete snapshot completed successfully.
Sep 10 11:55:10 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-2289f4be-54ef-4af9-9df6-346e43809c6e-delete_snapshot" released by "delete_snapshot" :: held 2.421s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:55:11 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Snapshots deleted, issuing volume delete {{(pid=82594) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 10 11:55:11 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "cinder-quobyte-2d080f2c-ec34-42e1-aac2-7040a974e691" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:55:11 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-quobyte-2d080f2c-ec34-42e1-aac2-7040a974e691" acquired by "delete_volume" :: waited 0.019s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:55:11 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f65029ab-c51d-43ff-877f-e18656a06786 tempest-TestInstancesWithCinderVolumes-278728036 None] Acquiring lock "cinder-25af4e57-f266-481e-aba7-325fa60c9c89-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:55:11 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8328102-a772-4dc4-8760-a680f81b7c61]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:55:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:11 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f65029ab-c51d-43ff-877f-e18656a06786 tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "cinder-25af4e57-f266-481e-aba7-325fa60c9c89-delete_volume" acquired by "delete_volume" :: waited 0.222s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:55:11 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-f65029ab-c51d-43ff-877f-e18656a06786 tempest-TestInstancesWithCinderVolumes-278728036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:55:11 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f65029ab-c51d-43ff-877f-e18656a06786 tempest-TestInstancesWithCinderVolumes-278728036 None] Acquiring lock "cinder-quobyte-25af4e57-f266-481e-aba7-325fa60c9c89" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:55:11 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f65029ab-c51d-43ff-877f-e18656a06786 tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "cinder-quobyte-25af4e57-f266-481e-aba7-325fa60c9c89" acquired by "delete_volume" :: waited 0.021s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:55:11 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b40085-0160-4b25-aed7-68c200a1689c]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:55:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f65029ab-c51d-43ff-877f-e18656a06786 tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-25af4e57-f266-481e-aba7-325fa60c9c89 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:11 devstack quobyte-client[82616]: System call of process 95441 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:55:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691" returned: 0 in 0.884s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-2d080f2c-ec34-42e1-aac2-7040a974e691" returned: 0 in 0.149s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:12 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-quobyte-2d080f2c-ec34-42e1-aac2-7040a974e691" released by "delete_volume" :: held 1.312s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:55:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f65029ab-c51d-43ff-877f-e18656a06786 tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-25af4e57-f266-481e-aba7-325fa60c9c89" returned: 0 in 0.736s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f65029ab-c51d-43ff-877f-e18656a06786 tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-25af4e57-f266-481e-aba7-325fa60c9c89 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:12 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Created reservations ['1766c780-037d-4cf2-a8b9-607becf895d2', '2efe8c75-fbed-490f-bf12-e75ce0c80476', '905e3c6b-d62c-4553-8c0e-9a20bdc553db', 'a4db607c-ad2b-454b-8b6e-df93111fbcc0'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:55:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f65029ab-c51d-43ff-877f-e18656a06786 tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-25af4e57-f266-481e-aba7-325fa60c9c89" returned: 0 in 0.412s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:13 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f65029ab-c51d-43ff-877f-e18656a06786 tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "cinder-quobyte-25af4e57-f266-481e-aba7-325fa60c9c89" released by "delete_volume" :: held 1.291s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:55:13 devstack cinder-volume[82594]: WARNING cinder.quota [None req-f65029ab-c51d-43ff-877f-e18656a06786 tempest-TestInstancesWithCinderVolumes-278728036 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-855874638-1906073782 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-855874638-1906073782, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:55:13 devstack cinder-volume[82594]: WARNING cinder.quota [None req-f65029ab-c51d-43ff-877f-e18656a06786 tempest-TestInstancesWithCinderVolumes-278728036 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-855874638-1906073782 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-855874638-1906073782, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:55:13 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-f65029ab-c51d-43ff-877f-e18656a06786 tempest-TestInstancesWithCinderVolumes-278728036 None] Created reservations ['a5415c56-0416-419c-88ea-59dbb4785daa', '1ca2b78b-b702-438a-a069-d8a490ec6314', '5f6869be-7e59-40b3-ad42-cfce8df39a35', '19301ef8-d6a9-43c6-9158-b6a9ff83f486'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:55:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:55:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:55:13 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:55:13 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:55:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:55:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.922s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:14 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:55:14 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Deleted volume successfully.
Sep 10 11:55:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f65029ab-c51d-43ff-877f-e18656a06786 tempest-TestInstancesWithCinderVolumes-278728036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:55:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f65029ab-c51d-43ff-877f-e18656a06786 tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:55:14 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f65029ab-c51d-43ff-877f-e18656a06786 tempest-TestInstancesWithCinderVolumes-278728036 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:55:14 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f65029ab-c51d-43ff-877f-e18656a06786 tempest-TestInstancesWithCinderVolumes-278728036 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:55:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f65029ab-c51d-43ff-877f-e18656a06786 tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:55:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f65029ab-c51d-43ff-877f-e18656a06786 tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f65029ab-c51d-43ff-877f-e18656a06786 tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.462s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:15 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-f65029ab-c51d-43ff-877f-e18656a06786 tempest-TestInstancesWithCinderVolumes-278728036 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:55:15 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-6fab9c24-a4fb-4a4e-8245-b161974f9529 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-2d080f2c-ec34-42e1-aac2-7040a974e691-delete_volume" released by "delete_volume" :: held 7.112s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:55:15 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-29ffae6b-5ba2-4086-afcf-ac4ff769eb73 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "cinder-711447ec-a762-489c-8893-00c038965e9a-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:55:15 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-f65029ab-c51d-43ff-877f-e18656a06786 tempest-TestInstancesWithCinderVolumes-278728036 None] Deleted volume successfully.
Sep 10 11:55:15 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-29ffae6b-5ba2-4086-afcf-ac4ff769eb73 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-711447ec-a762-489c-8893-00c038965e9a-delete_volume" acquired by "delete_volume" :: waited 0.214s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:55:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f65029ab-c51d-43ff-877f-e18656a06786 tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "cinder-25af4e57-f266-481e-aba7-325fa60c9c89-delete_volume" released by "delete_volume" :: held 4.749s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:55:16 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=64,cinder:UPDATE=76,cinder:INSERT=21,cinder:DELETE=5 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:55:16 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-29ffae6b-5ba2-4086-afcf-ac4ff769eb73 tempest-VolumesDeleteCascade-1601729419 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:55:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-29ffae6b-5ba2-4086-afcf-ac4ff769eb73 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "cinder-quobyte-711447ec-a762-489c-8893-00c038965e9a" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:55:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-29ffae6b-5ba2-4086-afcf-ac4ff769eb73 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-quobyte-711447ec-a762-489c-8893-00c038965e9a" acquired by "delete_volume" :: waited 0.021s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:55:16 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b420383-ad0a-475b-9c34-8a53f19cacb3]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:55:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-29ffae6b-5ba2-4086-afcf-ac4ff769eb73 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-711447ec-a762-489c-8893-00c038965e9a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:17 devstack quobyte-client[82616]: System call of process 95680 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:55:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-29ffae6b-5ba2-4086-afcf-ac4ff769eb73 tempest-VolumesDeleteCascade-1601729419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-711447ec-a762-489c-8893-00c038965e9a" returned: 0 in 0.871s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-29ffae6b-5ba2-4086-afcf-ac4ff769eb73 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-711447ec-a762-489c-8893-00c038965e9a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-29ffae6b-5ba2-4086-afcf-ac4ff769eb73 tempest-VolumesDeleteCascade-1601729419 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-711447ec-a762-489c-8893-00c038965e9a" returned: 0 in 0.159s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:17 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-29ffae6b-5ba2-4086-afcf-ac4ff769eb73 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-quobyte-711447ec-a762-489c-8893-00c038965e9a" released by "delete_volume" :: held 1.433s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:55:18 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=60,cinder:DELETE=7,cinder:SELECT=45,cinder:INSERT=11 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:55:18 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-29ffae6b-5ba2-4086-afcf-ac4ff769eb73 tempest-VolumesDeleteCascade-1601729419 None] Created reservations ['51617aa8-efcf-401a-9c3d-679018292fd7', 'badd09b5-b47e-4c72-bb5c-513550a643a5', '1f0bd12c-6a38-47b6-9d3a-ebad5cf52340', 'c4c91261-910f-4ace-a0ee-fcd13dad52c2'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:55:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-29ffae6b-5ba2-4086-afcf-ac4ff769eb73 tempest-VolumesDeleteCascade-1601729419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:55:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-29ffae6b-5ba2-4086-afcf-ac4ff769eb73 tempest-VolumesDeleteCascade-1601729419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:55:18 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-29ffae6b-5ba2-4086-afcf-ac4ff769eb73 tempest-VolumesDeleteCascade-1601729419 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:55:18 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-29ffae6b-5ba2-4086-afcf-ac4ff769eb73 tempest-VolumesDeleteCascade-1601729419 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:55:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-29ffae6b-5ba2-4086-afcf-ac4ff769eb73 tempest-VolumesDeleteCascade-1601729419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:55:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-29ffae6b-5ba2-4086-afcf-ac4ff769eb73 tempest-VolumesDeleteCascade-1601729419 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-29ffae6b-5ba2-4086-afcf-ac4ff769eb73 tempest-VolumesDeleteCascade-1601729419 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.197s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:18 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-29ffae6b-5ba2-4086-afcf-ac4ff769eb73 tempest-VolumesDeleteCascade-1601729419 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:55:19 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-29ffae6b-5ba2-4086-afcf-ac4ff769eb73 tempest-VolumesDeleteCascade-1601729419 None] Deleted volume successfully.
Sep 10 11:55:20 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-29ffae6b-5ba2-4086-afcf-ac4ff769eb73 tempest-VolumesDeleteCascade-1601729419 None] Lock "cinder-711447ec-a762-489c-8893-00c038965e9a-delete_volume" released by "delete_volume" :: held 4.087s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:55:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:55:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:55:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:55:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:55:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:55:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:55:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.314s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:23 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:55:26 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-83553b87-69ff-4a57-877b-d654a335e151 req-639a984c-10f4-4b76-aa8b-230a595b3dcc tempest-TestInstancesWithCinderVolumes-278728036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:55:26 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-83553b87-69ff-4a57-877b-d654a335e151 req-639a984c-10f4-4b76-aa8b-230a595b3dcc tempest-TestInstancesWithCinderVolumes-278728036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:55:26 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-83553b87-69ff-4a57-877b-d654a335e151 req-639a984c-10f4-4b76-aa8b-230a595b3dcc tempest-TestInstancesWithCinderVolumes-278728036 None] Terminate volume connection completed successfully.
Sep 10 11:55:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-83553b87-69ff-4a57-877b-d654a335e151 req-639a984c-10f4-4b76-aa8b-230a595b3dcc tempest-TestInstancesWithCinderVolumes-278728036 None] Deleting attachment 66955212-72fe-404e-861b-f1ed06394da6. {{(pid=82594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 11:55:27 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:55:27 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:55:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Flow 'volume_create_manager' (593ea1a5-7ab1-4b47-b8aa-910fe44bc89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:55:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (751e1b72-9849-4a48-8094-fe6eaedd6b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:55:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (751e1b72-9849-4a48-8094-fe6eaedd6b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1845003264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8a4d01-519c-4f3e-ae92-86d3667d6cb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd8e1205fcbd4701a199dc7d5980cf75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:55:28Z,use_quota=True,user_id='d9f924c790ae40e29ee15bb77a012fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:55:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07cdbb2b-8adf-4a9c-8677-42ac439c6361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:55:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07cdbb2b-8adf-4a9c-8677-42ac439c6361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:55:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a6ede09-41c8-4b32-8236-551cdf648831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:55:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a6ede09-41c8-4b32-8236-551cdf648831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e8a4d01-519c-4f3e-ae92-86d3667d6cb2', 'volume_name': 'volume-5e8a4d01-519c-4f3e-ae92-86d3667d6cb2', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:55:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d4b95db-be08-4b52-9d82-275754e8e283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:55:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d4b95db-be08-4b52-9d82-275754e8e283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:55:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a8f8b0-a7e2-4dd4-8e87-b2a596c36535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:55:27 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Volume 5e8a4d01-519c-4f3e-ae92-86d3667d6cb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e8a4d01-519c-4f3e-ae92-86d3667d6cb2', 'volume_size': 1}
Sep 10 11:55:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:55:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:55:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1845003264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8a4d01-519c-4f3e-ae92-86d3667d6cb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd8e1205fcbd4701a199dc7d5980cf75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:55:28Z,use_quota=True,user_id='d9f924c790ae40e29ee15bb77a012fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:55:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Creating volume 5e8a4d01-519c-4f3e-ae92-86d3667d6cb2 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:55:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:55:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:55:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:55:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:55:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:55:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:55:27 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:55:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5e8a4d01-519c-4f3e-ae92-86d3667d6cb2 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:28 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=105, name=volume-5e8a4d01-519c-4f3e-ae92-86d3667d6cb2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:55:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5e8a4d01-519c-4f3e-ae92-86d3667d6cb2 1073741824" returned: 0 in 0.395s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5e8a4d01-519c-4f3e-ae92-86d3667d6cb2 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5e8a4d01-519c-4f3e-ae92-86d3667d6cb2" returned: 0 in 0.115s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] <== create_volume: return (581ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:55:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.592s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:55:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a8f8b0-a7e2-4dd4-8e87-b2a596c36535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e8a4d01-519c-4f3e-ae92-86d3667d6cb2', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:55:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b371844e-acba-4156-8c8b-b6a9cd48ecdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:55:28 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Volume volume-5e8a4d01-519c-4f3e-ae92-86d3667d6cb2 (5e8a4d01-519c-4f3e-ae92-86d3667d6cb2): created successfully
Sep 10 11:55:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b371844e-acba-4156-8c8b-b6a9cd48ecdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:55:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Flow 'volume_create_manager' (593ea1a5-7ab1-4b47-b8aa-910fe44bc89a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:55:28 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-e4d22504-63e5-4ea9-9ea5-9017fa5eba6d tempest-VolumesMetadataTest-1902726059 None] Created volume successfully.
Sep 10 11:55:30 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-48096ea5-b885-4ab2-8b61-1b97df8fccc7 tempest-TestInstancesWithCinderVolumes-278728036 None] Acquiring lock "cinder-5b59109f-8a4d-42a5-8d27-796254f4bc4e-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:55:30 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-48096ea5-b885-4ab2-8b61-1b97df8fccc7 tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "cinder-5b59109f-8a4d-42a5-8d27-796254f4bc4e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:55:30 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-48096ea5-b885-4ab2-8b61-1b97df8fccc7 tempest-TestInstancesWithCinderVolumes-278728036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:55:30 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-48096ea5-b885-4ab2-8b61-1b97df8fccc7 tempest-TestInstancesWithCinderVolumes-278728036 None] Acquiring lock "cinder-quobyte-5b59109f-8a4d-42a5-8d27-796254f4bc4e" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:55:30 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-48096ea5-b885-4ab2-8b61-1b97df8fccc7 tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "cinder-quobyte-5b59109f-8a4d-42a5-8d27-796254f4bc4e" acquired by "delete_volume" :: waited 0.018s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:55:30 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cfaa59-7de8-4399-92cc-47bfb7e154d8]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:55:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-48096ea5-b885-4ab2-8b61-1b97df8fccc7 tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-48096ea5-b885-4ab2-8b61-1b97df8fccc7 tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e" returned: 0 in 0.539s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-48096ea5-b885-4ab2-8b61-1b97df8fccc7 tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:31 devstack quobyte-client[82616]: System call of process 95749 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:55:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-48096ea5-b885-4ab2-8b61-1b97df8fccc7 tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e" returned: 1 in 0.457s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-48096ea5-b885-4ab2-8b61-1b97df8fccc7 tempest-TestInstancesWithCinderVolumes-278728036 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 11:55:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-48096ea5-b885-4ab2-8b61-1b97df8fccc7 tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-48096ea5-b885-4ab2-8b61-1b97df8fccc7 tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5b59109f-8a4d-42a5-8d27-796254f4bc4e" returned: 0 in 0.130s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:32 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1df1d9b3-3220-4c58-aa8d-1be94e4b7b6c tempest-VolumesMetadataTest-1902726059 None] Acquiring lock "cinder-5e8a4d01-519c-4f3e-ae92-86d3667d6cb2-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:55:32 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-48096ea5-b885-4ab2-8b61-1b97df8fccc7 tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "cinder-quobyte-5b59109f-8a4d-42a5-8d27-796254f4bc4e" released by "delete_volume" :: held 1.600s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:55:32 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1df1d9b3-3220-4c58-aa8d-1be94e4b7b6c tempest-VolumesMetadataTest-1902726059 None] Lock "cinder-5e8a4d01-519c-4f3e-ae92-86d3667d6cb2-delete_volume" acquired by "delete_volume" :: waited 0.190s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:55:32 devstack cinder-volume[82594]: WARNING cinder.quota [None req-48096ea5-b885-4ab2-8b61-1b97df8fccc7 tempest-TestInstancesWithCinderVolumes-278728036 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1401668471-882366106 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1401668471-882366106, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:55:32 devstack cinder-volume[82594]: WARNING cinder.quota [None req-48096ea5-b885-4ab2-8b61-1b97df8fccc7 tempest-TestInstancesWithCinderVolumes-278728036 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1401668471-882366106 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1401668471-882366106, it is now deprecated. Please use the default quota class for default quota.
Sep 10 11:55:32 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-1df1d9b3-3220-4c58-aa8d-1be94e4b7b6c tempest-VolumesMetadataTest-1902726059 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:55:32 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1df1d9b3-3220-4c58-aa8d-1be94e4b7b6c tempest-VolumesMetadataTest-1902726059 None] Acquiring lock "cinder-quobyte-5e8a4d01-519c-4f3e-ae92-86d3667d6cb2" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:55:32 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-48096ea5-b885-4ab2-8b61-1b97df8fccc7 tempest-TestInstancesWithCinderVolumes-278728036 None] Created reservations ['b39243eb-17d2-4fd3-93ad-415b89d68fb7', '9a523a2b-583e-4674-9546-71d4c40bf0b7', '755e8016-83bd-4e2b-bf8f-41251f1bb44a', '2abf2bd0-cd22-49d9-89e7-fe08fbf84427'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:55:32 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1df1d9b3-3220-4c58-aa8d-1be94e4b7b6c tempest-VolumesMetadataTest-1902726059 None] Lock "cinder-quobyte-5e8a4d01-519c-4f3e-ae92-86d3667d6cb2" acquired by "delete_volume" :: waited 0.027s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:55:32 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6561f9d-18a6-40bb-a822-985ed1cff29d]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:55:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1df1d9b3-3220-4c58-aa8d-1be94e4b7b6c tempest-VolumesMetadataTest-1902726059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5e8a4d01-519c-4f3e-ae92-86d3667d6cb2 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-48096ea5-b885-4ab2-8b61-1b97df8fccc7 tempest-TestInstancesWithCinderVolumes-278728036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:55:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-48096ea5-b885-4ab2-8b61-1b97df8fccc7 tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:55:32 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-48096ea5-b885-4ab2-8b61-1b97df8fccc7 tempest-TestInstancesWithCinderVolumes-278728036 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:55:32 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-48096ea5-b885-4ab2-8b61-1b97df8fccc7 tempest-TestInstancesWithCinderVolumes-278728036 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:55:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-48096ea5-b885-4ab2-8b61-1b97df8fccc7 tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:55:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-48096ea5-b885-4ab2-8b61-1b97df8fccc7 tempest-TestInstancesWithCinderVolumes-278728036 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1df1d9b3-3220-4c58-aa8d-1be94e4b7b6c tempest-VolumesMetadataTest-1902726059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5e8a4d01-519c-4f3e-ae92-86d3667d6cb2" returned: 0 in 0.641s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1df1d9b3-3220-4c58-aa8d-1be94e4b7b6c tempest-VolumesMetadataTest-1902726059 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5e8a4d01-519c-4f3e-ae92-86d3667d6cb2 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-48096ea5-b885-4ab2-8b61-1b97df8fccc7 tempest-TestInstancesWithCinderVolumes-278728036 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.228s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:33 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-48096ea5-b885-4ab2-8b61-1b97df8fccc7 tempest-TestInstancesWithCinderVolumes-278728036 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:55:33 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-48096ea5-b885-4ab2-8b61-1b97df8fccc7 tempest-TestInstancesWithCinderVolumes-278728036 None] Deleted volume successfully.
Sep 10 11:55:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1df1d9b3-3220-4c58-aa8d-1be94e4b7b6c tempest-VolumesMetadataTest-1902726059 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5e8a4d01-519c-4f3e-ae92-86d3667d6cb2" returned: 0 in 0.264s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-48096ea5-b885-4ab2-8b61-1b97df8fccc7 tempest-TestInstancesWithCinderVolumes-278728036 None] Lock "cinder-5b59109f-8a4d-42a5-8d27-796254f4bc4e-delete_volume" released by "delete_volume" :: held 3.093s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:55:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1df1d9b3-3220-4c58-aa8d-1be94e4b7b6c tempest-VolumesMetadataTest-1902726059 None] Lock "cinder-quobyte-5e8a4d01-519c-4f3e-ae92-86d3667d6cb2" released by "delete_volume" :: held 1.048s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:55:33 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-1df1d9b3-3220-4c58-aa8d-1be94e4b7b6c tempest-VolumesMetadataTest-1902726059 None] Created reservations ['54ed029e-2870-4d16-9dd7-ce34c6a71919', 'b5075598-f219-4c34-827d-54dd2d9cfc1c', 'ed7065d9-2fb8-4dae-aea2-3ccdf13a341e', '67c819e8-9dc5-42e7-93a2-0eb2478c55d6'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:55:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1df1d9b3-3220-4c58-aa8d-1be94e4b7b6c tempest-VolumesMetadataTest-1902726059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:55:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1df1d9b3-3220-4c58-aa8d-1be94e4b7b6c tempest-VolumesMetadataTest-1902726059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:55:33 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1df1d9b3-3220-4c58-aa8d-1be94e4b7b6c tempest-VolumesMetadataTest-1902726059 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:55:33 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1df1d9b3-3220-4c58-aa8d-1be94e4b7b6c tempest-VolumesMetadataTest-1902726059 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:55:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1df1d9b3-3220-4c58-aa8d-1be94e4b7b6c tempest-VolumesMetadataTest-1902726059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:55:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1df1d9b3-3220-4c58-aa8d-1be94e4b7b6c tempest-VolumesMetadataTest-1902726059 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1df1d9b3-3220-4c58-aa8d-1be94e4b7b6c tempest-VolumesMetadataTest-1902726059 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.110s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:33 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-1df1d9b3-3220-4c58-aa8d-1be94e4b7b6c tempest-VolumesMetadataTest-1902726059 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:55:33 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-1df1d9b3-3220-4c58-aa8d-1be94e4b7b6c tempest-VolumesMetadataTest-1902726059 None] Deleted volume successfully.
Sep 10 11:55:34 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1df1d9b3-3220-4c58-aa8d-1be94e4b7b6c tempest-VolumesMetadataTest-1902726059 None] Lock "cinder-5e8a4d01-519c-4f3e-ae92-86d3667d6cb2-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:55:40 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:55:40 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:55:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Flow 'volume_create_manager' (da35451f-5896-4a8a-a586-001fec60f9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:55:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d152283e-5f6d-4947-952c-9dc2d088a221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:55:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d152283e-5f6d-4947-952c-9dc2d088a221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1486426668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158c2590-f1dd-4139-8463-19e2a4e88286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbb397836ec844f4ae2398c5f3c2198c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:55:41Z,use_quota=True,user_id='db3a477b0cf34ba895ccb7887295007d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:55:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00cde473-a8d9-4dde-8161-d9fbc75eb4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:55:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00cde473-a8d9-4dde-8161-d9fbc75eb4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:55:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f10f89e0-01c6-4cbc-a8dd-421c8c88fb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:55:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f10f89e0-01c6-4cbc-a8dd-421c8c88fb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '158c2590-f1dd-4139-8463-19e2a4e88286', 'volume_name': 'volume-158c2590-f1dd-4139-8463-19e2a4e88286', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:55:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecffa6e5-9e0d-4ef9-9d09-8fd0f6a5eecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:55:41 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecffa6e5-9e0d-4ef9-9d09-8fd0f6a5eecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:55:41 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3416f9e3-0972-4c2d-a057-7e374f3b7768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:55:41 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Volume 158c2590-f1dd-4139-8463-19e2a4e88286: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-158c2590-f1dd-4139-8463-19e2a4e88286', 'volume_size': 1}
Sep 10 11:55:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:55:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:55:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1486426668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158c2590-f1dd-4139-8463-19e2a4e88286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbb397836ec844f4ae2398c5f3c2198c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:55:41Z,use_quota=True,user_id='db3a477b0cf34ba895ccb7887295007d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:55:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Creating volume 158c2590-f1dd-4139-8463-19e2a4e88286 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:55:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:55:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:55:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:55:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:55:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:55:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:55:41 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:55:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-158c2590-f1dd-4139-8463-19e2a4e88286 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:41 devstack quobyte-client[82616]: System call of process 95761 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:55:41 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=106, name=volume-158c2590-f1dd-4139-8463-19e2a4e88286, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:55:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-158c2590-f1dd-4139-8463-19e2a4e88286 1073741824" returned: 0 in 0.421s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-158c2590-f1dd-4139-8463-19e2a4e88286 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-158c2590-f1dd-4139-8463-19e2a4e88286" returned: 0 in 0.142s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] <== create_volume: return (628ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:55:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.642s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:55:41 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3416f9e3-0972-4c2d-a057-7e374f3b7768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-158c2590-f1dd-4139-8463-19e2a4e88286', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:55:41 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e35517-3753-456b-a2c5-0d8ba7b5677c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:55:42 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Volume volume-158c2590-f1dd-4139-8463-19e2a4e88286 (158c2590-f1dd-4139-8463-19e2a4e88286): created successfully
Sep 10 11:55:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e35517-3753-456b-a2c5-0d8ba7b5677c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:55:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Flow 'volume_create_manager' (da35451f-5896-4a8a-a586-001fec60f9c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:55:42 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-b133e68c-13ed-42c7-b3bd-dac536f53f20 tempest-VolumesTransfersV357Test-1544179050 None] Created volume successfully.
Sep 10 11:55:43 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-5de6ce9d-c58b-4fa1-8a45-b39edb33cf9e tempest-VolumesTransfersV357Test-1095214562 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:55:43 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-5de6ce9d-c58b-4fa1-8a45-b39edb33cf9e tempest-VolumesTransfersV357Test-1095214562 None] Transfer volume completed successfully.
Sep 10 11:55:45 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8d6643e6-2b7b-4f5b-813b-1fe61a001114 tempest-VolumesTransfersV357Test-703360014 None] Acquiring lock "cinder-158c2590-f1dd-4139-8463-19e2a4e88286-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:55:45 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8d6643e6-2b7b-4f5b-813b-1fe61a001114 tempest-VolumesTransfersV357Test-703360014 None] Lock "cinder-158c2590-f1dd-4139-8463-19e2a4e88286-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:55:45 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-8d6643e6-2b7b-4f5b-813b-1fe61a001114 tempest-VolumesTransfersV357Test-703360014 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:55:45 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8d6643e6-2b7b-4f5b-813b-1fe61a001114 tempest-VolumesTransfersV357Test-703360014 None] Acquiring lock "cinder-quobyte-158c2590-f1dd-4139-8463-19e2a4e88286" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:55:45 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8d6643e6-2b7b-4f5b-813b-1fe61a001114 tempest-VolumesTransfersV357Test-703360014 None] Lock "cinder-quobyte-158c2590-f1dd-4139-8463-19e2a4e88286" acquired by "delete_volume" :: waited 0.013s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:55:45 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2596a9f1-28a9-4c32-9cb8-037197a55ba6]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:55:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8d6643e6-2b7b-4f5b-813b-1fe61a001114 tempest-VolumesTransfersV357Test-703360014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-158c2590-f1dd-4139-8463-19e2a4e88286 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8d6643e6-2b7b-4f5b-813b-1fe61a001114 tempest-VolumesTransfersV357Test-703360014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-158c2590-f1dd-4139-8463-19e2a4e88286" returned: 0 in 0.505s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8d6643e6-2b7b-4f5b-813b-1fe61a001114 tempest-VolumesTransfersV357Test-703360014 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-158c2590-f1dd-4139-8463-19e2a4e88286 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8d6643e6-2b7b-4f5b-813b-1fe61a001114 tempest-VolumesTransfersV357Test-703360014 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-158c2590-f1dd-4139-8463-19e2a4e88286" returned: 0 in 0.106s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:46 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8d6643e6-2b7b-4f5b-813b-1fe61a001114 tempest-VolumesTransfersV357Test-703360014 None] Lock "cinder-quobyte-158c2590-f1dd-4139-8463-19e2a4e88286" released by "delete_volume" :: held 0.761s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:55:46 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-8d6643e6-2b7b-4f5b-813b-1fe61a001114 tempest-VolumesTransfersV357Test-703360014 None] Created reservations ['2802e6a4-d041-476f-9129-59fca0a8ad44', 'f8c09af6-4eb8-4eab-8327-ceea465ab8ff', 'afdbdd68-b0c9-4bb8-abed-04ca49f394e7', 'fce8e8d5-0abb-420a-b467-67d24bdd86fb'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:55:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8d6643e6-2b7b-4f5b-813b-1fe61a001114 tempest-VolumesTransfersV357Test-703360014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:55:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8d6643e6-2b7b-4f5b-813b-1fe61a001114 tempest-VolumesTransfersV357Test-703360014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:55:46 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-8d6643e6-2b7b-4f5b-813b-1fe61a001114 tempest-VolumesTransfersV357Test-703360014 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:55:46 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-8d6643e6-2b7b-4f5b-813b-1fe61a001114 tempest-VolumesTransfersV357Test-703360014 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:55:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8d6643e6-2b7b-4f5b-813b-1fe61a001114 tempest-VolumesTransfersV357Test-703360014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:55:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8d6643e6-2b7b-4f5b-813b-1fe61a001114 tempest-VolumesTransfersV357Test-703360014 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8d6643e6-2b7b-4f5b-813b-1fe61a001114 tempest-VolumesTransfersV357Test-703360014 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.199s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:46 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-8d6643e6-2b7b-4f5b-813b-1fe61a001114 tempest-VolumesTransfersV357Test-703360014 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:55:47 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-8d6643e6-2b7b-4f5b-813b-1fe61a001114 tempest-VolumesTransfersV357Test-703360014 None] Deleted volume successfully.
Sep 10 11:55:47 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8d6643e6-2b7b-4f5b-813b-1fe61a001114 tempest-VolumesTransfersV357Test-703360014 None] Lock "cinder-158c2590-f1dd-4139-8463-19e2a4e88286-delete_volume" released by "delete_volume" :: held 2.059s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:55:48 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Flow 'volume_create_manager' (317a775d-4bf5-46f4-adb6-9122d30e08c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e29a33f0-9e80-4924-93f6-9920b307a5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e29a33f0-9e80-4924-93f6-9920b307a5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1528193551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7ce3bfb-57fd-4100-97ae-4c64cbb7a328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbb397836ec844f4ae2398c5f3c2198c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:55:49Z,use_quota=True,user_id='db3a477b0cf34ba895ccb7887295007d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b4bc1d-a8e3-46af-bfb2-90aeeee1c0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b4bc1d-a8e3-46af-bfb2-90aeeee1c0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90f67d0a-ec20-425c-97bf-b961975ae410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90f67d0a-ec20-425c-97bf-b961975ae410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7ce3bfb-57fd-4100-97ae-4c64cbb7a328', 'volume_name': 'volume-c7ce3bfb-57fd-4100-97ae-4c64cbb7a328', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39d81dc-95ae-47f3-a13a-d324ab8f7cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39d81dc-95ae-47f3-a13a-d324ab8f7cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18899d2f-7a13-4b0f-8f79-ff8fde8059ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:55:49 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Volume c7ce3bfb-57fd-4100-97ae-4c64cbb7a328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7ce3bfb-57fd-4100-97ae-4c64cbb7a328', 'volume_size': 1}
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1528193551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7ce3bfb-57fd-4100-97ae-4c64cbb7a328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbb397836ec844f4ae2398c5f3c2198c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:55:49Z,use_quota=True,user_id='db3a477b0cf34ba895ccb7887295007d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Creating volume c7ce3bfb-57fd-4100-97ae-4c64cbb7a328 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:55:49 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c7ce3bfb-57fd-4100-97ae-4c64cbb7a328 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:49 devstack quobyte-client[82616]: System call of process 95772 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:55:49 devstack quobyte-client[82616]: System call of process 95772 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:55:49 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=107, name=volume-c7ce3bfb-57fd-4100-97ae-4c64cbb7a328, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c7ce3bfb-57fd-4100-97ae-4c64cbb7a328 1073741824" returned: 0 in 0.506s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c7ce3bfb-57fd-4100-97ae-4c64cbb7a328 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c7ce3bfb-57fd-4100-97ae-4c64cbb7a328" returned: 0 in 0.101s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] <== create_volume: return (690ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:55:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:55:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18899d2f-7a13-4b0f-8f79-ff8fde8059ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7ce3bfb-57fd-4100-97ae-4c64cbb7a328', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:55:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d2e6b0-c940-4cc2-8ce2-ec70b03526bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:55:50 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Volume volume-c7ce3bfb-57fd-4100-97ae-4c64cbb7a328 (c7ce3bfb-57fd-4100-97ae-4c64cbb7a328): created successfully
Sep 10 11:55:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d2e6b0-c940-4cc2-8ce2-ec70b03526bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:55:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Flow 'volume_create_manager' (317a775d-4bf5-46f4-adb6-9122d30e08c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:55:50 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-71c462ca-5505-4862-9cda-5fffb90ad549 tempest-VolumesTransfersV357Test-1544179050 None] Created volume successfully.
Sep 10 11:55:51 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8b8df294-0035-4447-af46-0039da796974 tempest-VolumesTransfersV357Test-703360014 None] Acquiring lock "cinder-c7ce3bfb-57fd-4100-97ae-4c64cbb7a328-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:55:51 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8b8df294-0035-4447-af46-0039da796974 tempest-VolumesTransfersV357Test-703360014 None] Lock "cinder-c7ce3bfb-57fd-4100-97ae-4c64cbb7a328-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:55:51 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-8b8df294-0035-4447-af46-0039da796974 tempest-VolumesTransfersV357Test-703360014 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:55:51 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8b8df294-0035-4447-af46-0039da796974 tempest-VolumesTransfersV357Test-703360014 None] Acquiring lock "cinder-quobyte-c7ce3bfb-57fd-4100-97ae-4c64cbb7a328" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:55:51 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8b8df294-0035-4447-af46-0039da796974 tempest-VolumesTransfersV357Test-703360014 None] Lock "cinder-quobyte-c7ce3bfb-57fd-4100-97ae-4c64cbb7a328" acquired by "delete_volume" :: waited 0.017s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:55:51 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b187fb-dfb4-419a-8383-c4650187a8a1]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:55:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8b8df294-0035-4447-af46-0039da796974 tempest-VolumesTransfersV357Test-703360014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c7ce3bfb-57fd-4100-97ae-4c64cbb7a328 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8b8df294-0035-4447-af46-0039da796974 tempest-VolumesTransfersV357Test-703360014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c7ce3bfb-57fd-4100-97ae-4c64cbb7a328" returned: 0 in 0.533s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8b8df294-0035-4447-af46-0039da796974 tempest-VolumesTransfersV357Test-703360014 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c7ce3bfb-57fd-4100-97ae-4c64cbb7a328 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8b8df294-0035-4447-af46-0039da796974 tempest-VolumesTransfersV357Test-703360014 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c7ce3bfb-57fd-4100-97ae-4c64cbb7a328" returned: 0 in 0.098s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:52 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8b8df294-0035-4447-af46-0039da796974 tempest-VolumesTransfersV357Test-703360014 None] Lock "cinder-quobyte-c7ce3bfb-57fd-4100-97ae-4c64cbb7a328" released by "delete_volume" :: held 0.829s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:55:52 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-8b8df294-0035-4447-af46-0039da796974 tempest-VolumesTransfersV357Test-703360014 None] Created reservations ['7d4773a0-6f08-4e65-b97d-3d41d1e8c476', '12aded7c-d28a-48b4-b7cf-f46aa5d6cd1e', '5d16f81a-62c5-4e3a-a439-6d82351eb6e6', '7042c061-300d-4c86-9a79-5f5c2033fb83'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:55:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8b8df294-0035-4447-af46-0039da796974 tempest-VolumesTransfersV357Test-703360014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:55:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8b8df294-0035-4447-af46-0039da796974 tempest-VolumesTransfersV357Test-703360014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:55:53 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-8b8df294-0035-4447-af46-0039da796974 tempest-VolumesTransfersV357Test-703360014 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:55:53 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-8b8df294-0035-4447-af46-0039da796974 tempest-VolumesTransfersV357Test-703360014 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:55:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8b8df294-0035-4447-af46-0039da796974 tempest-VolumesTransfersV357Test-703360014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:55:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8b8df294-0035-4447-af46-0039da796974 tempest-VolumesTransfersV357Test-703360014 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:55:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8b8df294-0035-4447-af46-0039da796974 tempest-VolumesTransfersV357Test-703360014 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.098s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:55:53 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-8b8df294-0035-4447-af46-0039da796974 tempest-VolumesTransfersV357Test-703360014 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:55:53 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-8b8df294-0035-4447-af46-0039da796974 tempest-VolumesTransfersV357Test-703360014 None] Deleted volume successfully.
Sep 10 11:55:53 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-8b8df294-0035-4447-af46-0039da796974 tempest-VolumesTransfersV357Test-703360014 None] Lock "cinder-c7ce3bfb-57fd-4100-97ae-4c64cbb7a328-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:56:03 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=33,cinder:INSERT=10,cinder:UPDATE=48,cinder:DELETE=3 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:56:03 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:56:03 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:56:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Flow 'volume_create_manager' (d5c27d22-bf3f-4d1e-879e-507f977c3547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:56:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952923e2-99d3-41f0-ae77-ee01236d684d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:56:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952923e2-99d3-41f0-ae77-ee01236d684d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-261244935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c2f2610-2adf-48b1-b71a-3d63028da868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5a369202da44dedbdacab62bea2f0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:56:03Z,use_quota=True,user_id='aca1502a58904cf5a83904d9f052844d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:56:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0358c282-d656-45b9-8d66-ee615bc3d3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:56:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0358c282-d656-45b9-8d66-ee615bc3d3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:56:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e623a40-d824-4a90-8f63-355b9bee6719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:56:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e623a40-d824-4a90-8f63-355b9bee6719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c2f2610-2adf-48b1-b71a-3d63028da868', 'volume_name': 'volume-3c2f2610-2adf-48b1-b71a-3d63028da868', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:56:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a85ba383-af18-461a-80f1-7675916e660c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:56:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a85ba383-af18-461a-80f1-7675916e660c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:56:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c293e1-bf01-4e75-aba0-8e1a62f7d0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:56:03 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Volume 3c2f2610-2adf-48b1-b71a-3d63028da868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c2f2610-2adf-48b1-b71a-3d63028da868', 'volume_size': 1}
Sep 10 11:56:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:56:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:56:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-261244935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c2f2610-2adf-48b1-b71a-3d63028da868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5a369202da44dedbdacab62bea2f0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:56:03Z,use_quota=True,user_id='aca1502a58904cf5a83904d9f052844d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:56:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Creating volume 3c2f2610-2adf-48b1-b71a-3d63028da868 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:56:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:56:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:56:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:56:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:56:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:56:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:56:03 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:56:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3c2f2610-2adf-48b1-b71a-3d63028da868 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:56:03 devstack quobyte-client[82616]: System call of process 95818 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:56:03 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=108, name=volume-3c2f2610-2adf-48b1-b71a-3d63028da868, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:56:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3c2f2610-2adf-48b1-b71a-3d63028da868 1073741824" returned: 0 in 0.532s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:56:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3c2f2610-2adf-48b1-b71a-3d63028da868 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:56:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3c2f2610-2adf-48b1-b71a-3d63028da868" returned: 0 in 0.201s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:56:04 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] <== create_volume: return (819ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:56:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:56:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c293e1-bf01-4e75-aba0-8e1a62f7d0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c2f2610-2adf-48b1-b71a-3d63028da868', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:56:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a5b6cb3-6c48-43e9-8740-03a20c9016cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:56:04 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Volume volume-3c2f2610-2adf-48b1-b71a-3d63028da868 (3c2f2610-2adf-48b1-b71a-3d63028da868): created successfully
Sep 10 11:56:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a5b6cb3-6c48-43e9-8740-03a20c9016cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:56:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Flow 'volume_create_manager' (d5c27d22-bf3f-4d1e-879e-507f977c3547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:56:04 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-ac95bf4a-5401-4ebb-8c30-97ad6ab410ba tempest-VolumesNegativeTest-248668867 None] Created volume successfully.
Sep 10 11:56:16 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:56:16 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=46,cinder:SELECT=24,cinder:INSERT=10,cinder:DELETE=6 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:56:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:56:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:56:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:56:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:56:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:56:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:56:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:56:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.147s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:56:22 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:56:26 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:56:26 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:56:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Flow 'volume_create_manager' (ca185cfe-916a-42c8-a766-7552af20f8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:56:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c03713-90a0-4a95-95d5-fdecf5f23fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:56:26 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:56:26 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:56:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Flow 'volume_create_manager' (5604de31-e019-4f3c-86e5-4d0206ea9d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:56:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (221d83c5-25d3-4d78-a826-1b21d64f17c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:56:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c03713-90a0-4a95-95d5-fdecf5f23fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-278853897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f05be0-716d-4d4c-b720-46e90a17a17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c641899abc540af9abad3e5470b7118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:56:26Z,use_quota=True,user_id='7db50bd31c95411884b6f4f5a8552488',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:56:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ef4ea3-e16c-4de7-b176-a7857613a467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:56:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ef4ea3-e16c-4de7-b176-a7857613a467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:56:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80438bbc-0711-48c4-b38b-fe0c16539263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:56:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80438bbc-0711-48c4-b38b-fe0c16539263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94f05be0-716d-4d4c-b720-46e90a17a17a', 'volume_name': 'volume-94f05be0-716d-4d4c-b720-46e90a17a17a', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:56:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc0cd53-48fb-4718-9666-89f3de6d864f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:56:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc0cd53-48fb-4718-9666-89f3de6d864f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:56:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b9b600-6097-4ea7-a1ea-a8049ed9e84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:56:26 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Volume 94f05be0-716d-4d4c-b720-46e90a17a17a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94f05be0-716d-4d4c-b720-46e90a17a17a', 'volume_size': 1}
Sep 10 11:56:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:56:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.021s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:56:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-278853897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f05be0-716d-4d4c-b720-46e90a17a17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c641899abc540af9abad3e5470b7118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:56:26Z,use_quota=True,user_id='7db50bd31c95411884b6f4f5a8552488',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:56:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Creating volume 94f05be0-716d-4d4c-b720-46e90a17a17a {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:56:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:56:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:56:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:56:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:56:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:56:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:56:26 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:56:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-94f05be0-716d-4d4c-b720-46e90a17a17a 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:56:27 devstack quobyte-client[82616]: System call of process 95856 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:56:27 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=109, name=volume-94f05be0-716d-4d4c-b720-46e90a17a17a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:56:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (221d83c5-25d3-4d78-a826-1b21d64f17c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1249717247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f88b3495-f92c-4f3e-a6ff-4869d186b5f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c641899abc540af9abad3e5470b7118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:56:26Z,use_quota=True,user_id='7db50bd31c95411884b6f4f5a8552488',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:56:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55be3297-52b5-4b17-96e5-f1f0941e85fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:56:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55be3297-52b5-4b17-96e5-f1f0941e85fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:56:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a09f68-4f48-40e5-a8c7-fb516b1b1043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:56:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a09f68-4f48-40e5-a8c7-fb516b1b1043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f88b3495-f92c-4f3e-a6ff-4869d186b5f5', 'volume_name': 'volume-f88b3495-f92c-4f3e-a6ff-4869d186b5f5', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:56:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f29a1d-e3a2-4831-9304-92f8c5f2172c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:56:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f29a1d-e3a2-4831-9304-92f8c5f2172c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:56:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d80616b7-3dd8-41fc-90a1-77413c3c41bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:56:28 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Volume f88b3495-f92c-4f3e-a6ff-4869d186b5f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f88b3495-f92c-4f3e-a6ff-4869d186b5f5', 'volume_size': 1}
Sep 10 11:56:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:56:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-94f05be0-716d-4d4c-b720-46e90a17a17a 1073741824" returned: 0 in 1.493s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:56:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-94f05be0-716d-4d4c-b720-46e90a17a17a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:56:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-94f05be0-716d-4d4c-b720-46e90a17a17a" returned: 0 in 0.201s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:56:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] <== create_volume: return (1795ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:56:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:56:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.565s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:56:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1249717247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f88b3495-f92c-4f3e-a6ff-4869d186b5f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c641899abc540af9abad3e5470b7118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:56:26Z,use_quota=True,user_id='7db50bd31c95411884b6f4f5a8552488',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:56:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Creating volume f88b3495-f92c-4f3e-a6ff-4869d186b5f5 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:56:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:56:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:56:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:56:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:56:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:56:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:56:29 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:56:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f88b3495-f92c-4f3e-a6ff-4869d186b5f5 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:56:29 devstack quobyte-client[82616]: System call of process 95885 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:56:29 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=110, name=volume-f88b3495-f92c-4f3e-a6ff-4869d186b5f5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:56:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b9b600-6097-4ea7-a1ea-a8049ed9e84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94f05be0-716d-4d4c-b720-46e90a17a17a', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:56:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7b8516-3db5-4afd-b43f-265a27f83196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:56:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f88b3495-f92c-4f3e-a6ff-4869d186b5f5 1073741824" returned: 0 in 1.418s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:56:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f88b3495-f92c-4f3e-a6ff-4869d186b5f5 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:56:31 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Volume volume-94f05be0-716d-4d4c-b720-46e90a17a17a (94f05be0-716d-4d4c-b720-46e90a17a17a): created successfully
Sep 10 11:56:31 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7b8516-3db5-4afd-b43f-265a27f83196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:56:31 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Flow 'volume_create_manager' (ca185cfe-916a-42c8-a766-7552af20f8d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:56:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f88b3495-f92c-4f3e-a6ff-4869d186b5f5" returned: 0 in 1.036s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:56:31 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] <== create_volume: return (2524ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:56:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.592s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:56:31 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-1d27132c-9a76-4699-bcf2-7b0235b8421a tempest-TestServerVolumeAttachmentScenario-768493754 None] Created volume successfully.
Sep 10 11:56:31 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d80616b7-3dd8-41fc-90a1-77413c3c41bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f88b3495-f92c-4f3e-a6ff-4869d186b5f5', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:56:31 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d559f46-fa4e-4233-befa-01504754d9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:56:31 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Volume volume-f88b3495-f92c-4f3e-a6ff-4869d186b5f5 (f88b3495-f92c-4f3e-a6ff-4869d186b5f5): created successfully
Sep 10 11:56:31 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d559f46-fa4e-4233-befa-01504754d9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:56:31 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Flow 'volume_create_manager' (5604de31-e019-4f3c-86e5-4d0206ea9d3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:56:31 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-737642f0-2eaf-4bec-bcee-b7b888a2d86e tempest-TestServerVolumeAttachmentScenario-768493754 None] Created volume successfully.
Sep 10 11:56:41 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:56:41 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:56:58 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-abcdc760-3092-4f57-b180-24d37425563e tempest-VolumesNegativeTest-248668867 None] Acquiring lock "cinder-3c2f2610-2adf-48b1-b71a-3d63028da868-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:56:58 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-abcdc760-3092-4f57-b180-24d37425563e tempest-VolumesNegativeTest-248668867 None] Lock "cinder-3c2f2610-2adf-48b1-b71a-3d63028da868-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:56:59 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-abcdc760-3092-4f57-b180-24d37425563e tempest-VolumesNegativeTest-248668867 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:56:59 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-abcdc760-3092-4f57-b180-24d37425563e tempest-VolumesNegativeTest-248668867 None] Acquiring lock "cinder-quobyte-3c2f2610-2adf-48b1-b71a-3d63028da868" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:56:59 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-abcdc760-3092-4f57-b180-24d37425563e tempest-VolumesNegativeTest-248668867 None] Lock "cinder-quobyte-3c2f2610-2adf-48b1-b71a-3d63028da868" acquired by "delete_volume" :: waited 0.034s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:56:59 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2a7447-ef91-40ad-932b-87ec13e33ebc]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:56:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-abcdc760-3092-4f57-b180-24d37425563e tempest-VolumesNegativeTest-248668867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3c2f2610-2adf-48b1-b71a-3d63028da868 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:56:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-abcdc760-3092-4f57-b180-24d37425563e tempest-VolumesNegativeTest-248668867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3c2f2610-2adf-48b1-b71a-3d63028da868" returned: 0 in 0.550s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:56:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-abcdc760-3092-4f57-b180-24d37425563e tempest-VolumesNegativeTest-248668867 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3c2f2610-2adf-48b1-b71a-3d63028da868 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:56:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-abcdc760-3092-4f57-b180-24d37425563e tempest-VolumesNegativeTest-248668867 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3c2f2610-2adf-48b1-b71a-3d63028da868" returned: 0 in 0.113s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:56:59 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-abcdc760-3092-4f57-b180-24d37425563e tempest-VolumesNegativeTest-248668867 None] Lock "cinder-quobyte-3c2f2610-2adf-48b1-b71a-3d63028da868" released by "delete_volume" :: held 0.843s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:57:00 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-abcdc760-3092-4f57-b180-24d37425563e tempest-VolumesNegativeTest-248668867 None] Created reservations ['978f1c0d-b8f6-41df-b761-d682666734de', '1d65f372-6916-483d-87a1-b4c75f4215f3', '685802a9-e7c2-4e81-a89f-88c185f1b021', '40fb0c1a-2395-4bf5-bfe2-3f53d3ff4ff4'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:57:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-abcdc760-3092-4f57-b180-24d37425563e tempest-VolumesNegativeTest-248668867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:57:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-abcdc760-3092-4f57-b180-24d37425563e tempest-VolumesNegativeTest-248668867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:57:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-abcdc760-3092-4f57-b180-24d37425563e tempest-VolumesNegativeTest-248668867 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:57:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-abcdc760-3092-4f57-b180-24d37425563e tempest-VolumesNegativeTest-248668867 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:57:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-abcdc760-3092-4f57-b180-24d37425563e tempest-VolumesNegativeTest-248668867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:57:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-abcdc760-3092-4f57-b180-24d37425563e tempest-VolumesNegativeTest-248668867 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-abcdc760-3092-4f57-b180-24d37425563e tempest-VolumesNegativeTest-248668867 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.103s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:00 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-abcdc760-3092-4f57-b180-24d37425563e tempest-VolumesNegativeTest-248668867 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:57:00 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-abcdc760-3092-4f57-b180-24d37425563e tempest-VolumesNegativeTest-248668867 None] Deleted volume successfully.
Sep 10 11:57:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-abcdc760-3092-4f57-b180-24d37425563e tempest-VolumesNegativeTest-248668867 None] Lock "cinder-3c2f2610-2adf-48b1-b71a-3d63028da868-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:57:05 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:57:05 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:57:05 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Flow 'volume_create_manager' (1c401ffe-7756-4578-9a8b-c4c655563c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:57:05 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a666d5c-80b0-4d27-bf85-e11fb58847e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:57:05 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a666d5c-80b0-4d27-bf85-e11fb58847e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2133373995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba17fe1-ed85-49b0-a721-4b44b936d150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5710c233bfa641f7a6055da6c1433534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:57:05Z,use_quota=True,user_id='81c2f6d3bf684081bd00f78cf3629d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:57:05 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf71281-d7f0-4606-8eae-12a31d1a6306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:57:05 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf71281-d7f0-4606-8eae-12a31d1a6306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:57:05 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58f1c62-8971-4629-88bb-eb43c104738d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:57:05 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58f1c62-8971-4629-88bb-eb43c104738d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bba17fe1-ed85-49b0-a721-4b44b936d150', 'volume_name': 'volume-bba17fe1-ed85-49b0-a721-4b44b936d150', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:57:05 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28fbcfbb-4979-4d03-95f4-335ba3556390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:57:05 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28fbcfbb-4979-4d03-95f4-335ba3556390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:57:05 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d88f210a-9b32-4e0a-9ef2-e79198b776aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:57:05 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Volume bba17fe1-ed85-49b0-a721-4b44b936d150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bba17fe1-ed85-49b0-a721-4b44b936d150', 'volume_size': 1}
Sep 10 11:57:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:57:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:57:05 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2133373995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba17fe1-ed85-49b0-a721-4b44b936d150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5710c233bfa641f7a6055da6c1433534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:57:05Z,use_quota=True,user_id='81c2f6d3bf684081bd00f78cf3629d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:57:05 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Creating volume bba17fe1-ed85-49b0-a721-4b44b936d150 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:57:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:57:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:57:05 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:57:05 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:57:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:57:05 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:57:05 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:57:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:05 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=111, name=volume-bba17fe1-ed85-49b0-a721-4b44b936d150, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:57:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150 1073741824" returned: 0 in 0.603s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150" returned: 0 in 0.153s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:06 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] <== create_volume: return (873ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:57:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:57:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d88f210a-9b32-4e0a-9ef2-e79198b776aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bba17fe1-ed85-49b0-a721-4b44b936d150', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:57:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e78b7cc9-b19f-41dc-8eb5-c1c9fdf53a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:57:06 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Volume volume-bba17fe1-ed85-49b0-a721-4b44b936d150 (bba17fe1-ed85-49b0-a721-4b44b936d150): created successfully
Sep 10 11:57:06 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e78b7cc9-b19f-41dc-8eb5-c1c9fdf53a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:57:07 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Flow 'volume_create_manager' (1c401ffe-7756-4578-9a8b-c4c655563c95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:57:07 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-f5b62273-0cdc-443a-a140-f63bdaeac82a tempest-VolumesSnapshotListTestJSON-977426304 None] Created volume successfully.
Sep 10 11:57:07 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-8327e5be-e254-4bbb-9969-fe8160b8f5ba tempest-VolumesSnapshotListTestJSON-977426304 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:57:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8327e5be-e254-4bbb-9969-fe8160b8f5ba tempest-VolumesSnapshotListTestJSON-977426304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:57:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8327e5be-e254-4bbb-9969-fe8160b8f5ba tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:57:07 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-8327e5be-e254-4bbb-9969-fe8160b8f5ba tempest-VolumesSnapshotListTestJSON-977426304 None] Creating offline snapshot b3c119c6-4f8b-44f9-aa59-537ce529ba9f of volume bba17fe1-ed85-49b0-a721-4b44b936d150 {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 11:57:07 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24aef93-4ccc-4e2b-a341-d25d2d706b93]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:57:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8327e5be-e254-4bbb-9969-fe8160b8f5ba tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8327e5be-e254-4bbb-9969-fe8160b8f5ba tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150" returned: 0 in 0.447s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8327e5be-e254-4bbb-9969-fe8160b8f5ba tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:08 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=112, name=volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:57:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8327e5be-e254-4bbb-9969-fe8160b8f5ba tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f 1G" returned: 0 in 0.344s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8327e5be-e254-4bbb-9969-fe8160b8f5ba tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bba17fe1-ed85-49b0-a721-4b44b936d150 -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:08 devstack quobyte-client[82616]: System call of process 96130 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:57:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8327e5be-e254-4bbb-9969-fe8160b8f5ba tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "qemu-img rebase -u -b volume-bba17fe1-ed85-49b0-a721-4b44b936d150 -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f" returned: 0 in 0.155s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:08 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-8327e5be-e254-4bbb-9969-fe8160b8f5ba tempest-VolumesSnapshotListTestJSON-977426304 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:57:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8327e5be-e254-4bbb-9969-fe8160b8f5ba tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8327e5be-e254-4bbb-9969-fe8160b8f5ba tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f" returned: 0 in 0.104s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-8327e5be-e254-4bbb-9969-fe8160b8f5ba tempest-VolumesSnapshotListTestJSON-977426304 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150 -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 11:57:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8327e5be-e254-4bbb-9969-fe8160b8f5ba tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8327e5be-e254-4bbb-9969-fe8160b8f5ba tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f" returned: 0 in 0.090s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8327e5be-e254-4bbb-9969-fe8160b8f5ba tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8327e5be-e254-4bbb-9969-fe8160b8f5ba tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.info" returned: 0 in 0.098s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-8327e5be-e254-4bbb-9969-fe8160b8f5ba tempest-VolumesSnapshotListTestJSON-977426304 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.info is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:57:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8327e5be-e254-4bbb-9969-fe8160b8f5ba tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8327e5be-e254-4bbb-9969-fe8160b8f5ba tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.info" returned: 0 in 0.096s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8327e5be-e254-4bbb-9969-fe8160b8f5ba tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.669s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:57:09 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-8327e5be-e254-4bbb-9969-fe8160b8f5ba tempest-VolumesSnapshotListTestJSON-977426304 None] Create snapshot completed successfully
Sep 10 11:57:10 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-b8c3befd-c410-4904-9c46-4546cd25e8d3 tempest-VolumesSnapshotListTestJSON-977426304 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:57:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b8c3befd-c410-4904-9c46-4546cd25e8d3 tempest-VolumesSnapshotListTestJSON-977426304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:57:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b8c3befd-c410-4904-9c46-4546cd25e8d3 tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:57:10 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-b8c3befd-c410-4904-9c46-4546cd25e8d3 tempest-VolumesSnapshotListTestJSON-977426304 None] Creating offline snapshot 6c2b3c64-081b-4733-8b10-d8468dd24840 of volume bba17fe1-ed85-49b0-a721-4b44b936d150 {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 11:57:10 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d87c162-361d-4ffc-9957-752375014069]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:57:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b8c3befd-c410-4904-9c46-4546cd25e8d3 tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:10 devstack quobyte-client[82616]: System call of process 96137 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:57:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b8c3befd-c410-4904-9c46-4546cd25e8d3 tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f" returned: 0 in 0.437s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:10 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-b8c3befd-c410-4904-9c46-4546cd25e8d3 tempest-VolumesSnapshotListTestJSON-977426304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bba17fe1-ed85-49b0-a721-4b44b936d150(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:57:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b8c3befd-c410-4904-9c46-4546cd25e8d3 tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:11 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=114, name=volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:57:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b8c3befd-c410-4904-9c46-4546cd25e8d3 tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840 1G" returned: 0 in 0.319s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b8c3befd-c410-4904-9c46-4546cd25e8d3 tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b8c3befd-c410-4904-9c46-4546cd25e8d3 tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "qemu-img rebase -u -b volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840" returned: 0 in 0.156s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-b8c3befd-c410-4904-9c46-4546cd25e8d3 tempest-VolumesSnapshotListTestJSON-977426304 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840 is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:57:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b8c3befd-c410-4904-9c46-4546cd25e8d3 tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b8c3befd-c410-4904-9c46-4546cd25e8d3 tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840" returned: 0 in 0.169s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-b8c3befd-c410-4904-9c46-4546cd25e8d3 tempest-VolumesSnapshotListTestJSON-977426304 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 11:57:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b8c3befd-c410-4904-9c46-4546cd25e8d3 tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b8c3befd-c410-4904-9c46-4546cd25e8d3 tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840" returned: 0 in 0.133s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b8c3befd-c410-4904-9c46-4546cd25e8d3 tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.560s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:57:12 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-b8c3befd-c410-4904-9c46-4546cd25e8d3 tempest-VolumesSnapshotListTestJSON-977426304 None] Create snapshot completed successfully
Sep 10 11:57:12 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-c1df0e65-4508-43a7-8acc-15b4059f686c tempest-VolumesSnapshotListTestJSON-977426304 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:57:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-c1df0e65-4508-43a7-8acc-15b4059f686c tempest-VolumesSnapshotListTestJSON-977426304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:57:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-c1df0e65-4508-43a7-8acc-15b4059f686c tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:57:12 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-c1df0e65-4508-43a7-8acc-15b4059f686c tempest-VolumesSnapshotListTestJSON-977426304 None] Creating offline snapshot aed55bbe-46b0-4351-b737-b418e0efd30f of volume bba17fe1-ed85-49b0-a721-4b44b936d150 {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 11:57:12 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d8275d-2e1d-4479-8f1e-26171562b255]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:57:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c1df0e65-4508-43a7-8acc-15b4059f686c tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c1df0e65-4508-43a7-8acc-15b4059f686c tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840" returned: 0 in 0.425s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:13 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-c1df0e65-4508-43a7-8acc-15b4059f686c tempest-VolumesSnapshotListTestJSON-977426304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bba17fe1-ed85-49b0-a721-4b44b936d150(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:57:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c1df0e65-4508-43a7-8acc-15b4059f686c tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.aed55bbe-46b0-4351-b737-b418e0efd30f 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:13 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=115, name=volume-bba17fe1-ed85-49b0-a721-4b44b936d150.aed55bbe-46b0-4351-b737-b418e0efd30f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:57:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c1df0e65-4508-43a7-8acc-15b4059f686c tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.aed55bbe-46b0-4351-b737-b418e0efd30f 1G" returned: 0 in 0.425s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c1df0e65-4508-43a7-8acc-15b4059f686c tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840 -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.aed55bbe-46b0-4351-b737-b418e0efd30f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c1df0e65-4508-43a7-8acc-15b4059f686c tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "qemu-img rebase -u -b volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840 -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.aed55bbe-46b0-4351-b737-b418e0efd30f" returned: 0 in 0.173s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:14 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-c1df0e65-4508-43a7-8acc-15b4059f686c tempest-VolumesSnapshotListTestJSON-977426304 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.aed55bbe-46b0-4351-b737-b418e0efd30f is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 11:57:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c1df0e65-4508-43a7-8acc-15b4059f686c tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.aed55bbe-46b0-4351-b737-b418e0efd30f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c1df0e65-4508-43a7-8acc-15b4059f686c tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.aed55bbe-46b0-4351-b737-b418e0efd30f" returned: 0 in 0.094s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:14 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-c1df0e65-4508-43a7-8acc-15b4059f686c tempest-VolumesSnapshotListTestJSON-977426304 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840 -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 11:57:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c1df0e65-4508-43a7-8acc-15b4059f686c tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.aed55bbe-46b0-4351-b737-b418e0efd30f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c1df0e65-4508-43a7-8acc-15b4059f686c tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.aed55bbe-46b0-4351-b737-b418e0efd30f" returned: 0 in 0.101s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-c1df0e65-4508-43a7-8acc-15b4059f686c tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.509s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:57:14 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-c1df0e65-4508-43a7-8acc-15b4059f686c tempest-VolumesSnapshotListTestJSON-977426304 None] Create snapshot completed successfully
Sep 10 11:57:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-909546f4-ae75-4755-8d33-05aa86109de3 tempest-VolumesSnapshotListTestJSON-977426304 None] Acquiring lock "cinder-aed55bbe-46b0-4351-b737-b418e0efd30f-delete_snapshot" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:57:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-909546f4-ae75-4755-8d33-05aa86109de3 tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "cinder-aed55bbe-46b0-4351-b737-b418e0efd30f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:57:16 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-909546f4-ae75-4755-8d33-05aa86109de3 tempest-VolumesSnapshotListTestJSON-977426304 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:57:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-909546f4-ae75-4755-8d33-05aa86109de3 tempest-VolumesSnapshotListTestJSON-977426304 None] Acquiring lock "cinder-quobyte-bba17fe1-ed85-49b0-a721-4b44b936d150" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:57:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-909546f4-ae75-4755-8d33-05aa86109de3 tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "cinder-quobyte-bba17fe1-ed85-49b0-a721-4b44b936d150" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:57:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-909546f4-ae75-4755-8d33-05aa86109de3 tempest-VolumesSnapshotListTestJSON-977426304 None] Acquiring lock "cinder-quobyte-aed55bbe-46b0-4351-b737-b418e0efd30f" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:57:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-909546f4-ae75-4755-8d33-05aa86109de3 tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "cinder-quobyte-aed55bbe-46b0-4351-b737-b418e0efd30f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:57:16 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-909546f4-ae75-4755-8d33-05aa86109de3 tempest-VolumesSnapshotListTestJSON-977426304 None] Deleting offline snapshot aed55bbe-46b0-4351-b737-b418e0efd30f of volume bba17fe1-ed85-49b0-a721-4b44b936d150 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 11:57:16 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-909546f4-ae75-4755-8d33-05aa86109de3 tempest-VolumesSnapshotListTestJSON-977426304 None] snapshot_file for this snap is: volume-bba17fe1-ed85-49b0-a721-4b44b936d150.aed55bbe-46b0-4351-b737-b418e0efd30f {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 11:57:16 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e0b300-be2d-4a57-a308-a20138c77e08]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:57:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-909546f4-ae75-4755-8d33-05aa86109de3 tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.aed55bbe-46b0-4351-b737-b418e0efd30f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-909546f4-ae75-4755-8d33-05aa86109de3 tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.aed55bbe-46b0-4351-b737-b418e0efd30f" returned: 0 in 0.516s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:17 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-909546f4-ae75-4755-8d33-05aa86109de3 tempest-VolumesSnapshotListTestJSON-977426304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bba17fe1-ed85-49b0-a721-4b44b936d150(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:57:17 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced5b43d-0bec-4fdd-a1a9-9664a3a4b678]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:57:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-909546f4-ae75-4755-8d33-05aa86109de3 tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:17 devstack quobyte-client[82616]: System call of process 96163 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:57:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-909546f4-ae75-4755-8d33-05aa86109de3 tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840" returned: 0 in 0.537s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:17 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-909546f4-ae75-4755-8d33-05aa86109de3 tempest-VolumesSnapshotListTestJSON-977426304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bba17fe1-ed85-49b0-a721-4b44b936d150(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:57:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-909546f4-ae75-4755-8d33-05aa86109de3 tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.aed55bbe-46b0-4351-b737-b418e0efd30f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:17 devstack quobyte-client[82616]: System call of process 96166 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:57:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-909546f4-ae75-4755-8d33-05aa86109de3 tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.aed55bbe-46b0-4351-b737-b418e0efd30f" returned: 0 in 0.394s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-909546f4-ae75-4755-8d33-05aa86109de3 tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.aed55bbe-46b0-4351-b737-b418e0efd30f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-909546f4-ae75-4755-8d33-05aa86109de3 tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.aed55bbe-46b0-4351-b737-b418e0efd30f" returned: 0 in 0.144s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:18 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-909546f4-ae75-4755-8d33-05aa86109de3 tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "cinder-quobyte-aed55bbe-46b0-4351-b737-b418e0efd30f" released by "_delete_snapshot" :: held 1.983s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:57:18 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-909546f4-ae75-4755-8d33-05aa86109de3 tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "cinder-quobyte-bba17fe1-ed85-49b0-a721-4b44b936d150" released by "delete_snapshot" :: held 2.032s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:57:19 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-909546f4-ae75-4755-8d33-05aa86109de3 tempest-VolumesSnapshotListTestJSON-977426304 None] Created reservations ['3b9e4bcd-369f-49aa-b0fe-01cf2704a73a', '41a60229-f58e-45d9-b60c-ddc778acffd0', '0d3943b2-e049-4198-8786-1bda0d17212a', '733a1d9e-969c-4d5b-a24b-d2d1ebe9d605'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:57:19 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-909546f4-ae75-4755-8d33-05aa86109de3 tempest-VolumesSnapshotListTestJSON-977426304 None] Delete snapshot completed successfully.
Sep 10 11:57:19 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-909546f4-ae75-4755-8d33-05aa86109de3 tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "cinder-aed55bbe-46b0-4351-b737-b418e0efd30f-delete_snapshot" released by "delete_snapshot" :: held 2.866s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:57:20 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a8377e88-67cd-4a27-b259-0e86b2286a1d tempest-VolumesSnapshotListTestJSON-977426304 None] Acquiring lock "cinder-6c2b3c64-081b-4733-8b10-d8468dd24840-delete_snapshot" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:57:20 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a8377e88-67cd-4a27-b259-0e86b2286a1d tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "cinder-6c2b3c64-081b-4733-8b10-d8468dd24840-delete_snapshot" acquired by "delete_snapshot" :: waited 0.093s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:57:20 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-a8377e88-67cd-4a27-b259-0e86b2286a1d tempest-VolumesSnapshotListTestJSON-977426304 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:57:20 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a8377e88-67cd-4a27-b259-0e86b2286a1d tempest-VolumesSnapshotListTestJSON-977426304 None] Acquiring lock "cinder-quobyte-bba17fe1-ed85-49b0-a721-4b44b936d150" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:57:20 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a8377e88-67cd-4a27-b259-0e86b2286a1d tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "cinder-quobyte-bba17fe1-ed85-49b0-a721-4b44b936d150" acquired by "delete_snapshot" :: waited 0.041s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:57:20 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a8377e88-67cd-4a27-b259-0e86b2286a1d tempest-VolumesSnapshotListTestJSON-977426304 None] Acquiring lock "cinder-quobyte-6c2b3c64-081b-4733-8b10-d8468dd24840" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:57:20 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a8377e88-67cd-4a27-b259-0e86b2286a1d tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "cinder-quobyte-6c2b3c64-081b-4733-8b10-d8468dd24840" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:57:20 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-a8377e88-67cd-4a27-b259-0e86b2286a1d tempest-VolumesSnapshotListTestJSON-977426304 None] Deleting offline snapshot 6c2b3c64-081b-4733-8b10-d8468dd24840 of volume bba17fe1-ed85-49b0-a721-4b44b936d150 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 11:57:20 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-a8377e88-67cd-4a27-b259-0e86b2286a1d tempest-VolumesSnapshotListTestJSON-977426304 None] snapshot_file for this snap is: volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 11:57:20 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64b0155-aafc-4d46-8d68-4c9a15623c1d]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:57:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a8377e88-67cd-4a27-b259-0e86b2286a1d tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:21 devstack quobyte-client[82616]: System call of process 96173 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:57:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a8377e88-67cd-4a27-b259-0e86b2286a1d tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840" returned: 0 in 0.811s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-a8377e88-67cd-4a27-b259-0e86b2286a1d tempest-VolumesSnapshotListTestJSON-977426304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bba17fe1-ed85-49b0-a721-4b44b936d150(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:57:21 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed94793-8618-4518-a48a-8b49e8e659ca]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:57:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a8377e88-67cd-4a27-b259-0e86b2286a1d tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:21 devstack quobyte-client[82616]: System call of process 96180 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:57:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a8377e88-67cd-4a27-b259-0e86b2286a1d tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f" returned: 0 in 0.600s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-a8377e88-67cd-4a27-b259-0e86b2286a1d tempest-VolumesSnapshotListTestJSON-977426304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bba17fe1-ed85-49b0-a721-4b44b936d150(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:57:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a8377e88-67cd-4a27-b259-0e86b2286a1d tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a8377e88-67cd-4a27-b259-0e86b2286a1d tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840" returned: 0 in 0.349s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a8377e88-67cd-4a27-b259-0e86b2286a1d tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a8377e88-67cd-4a27-b259-0e86b2286a1d tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.6c2b3c64-081b-4733-8b10-d8468dd24840" returned: 0 in 0.185s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:57:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:57:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:57:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:57:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:57:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:57:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.165s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:23 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:57:23 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a8377e88-67cd-4a27-b259-0e86b2286a1d tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "cinder-quobyte-6c2b3c64-081b-4733-8b10-d8468dd24840" released by "_delete_snapshot" :: held 2.939s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:57:23 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a8377e88-67cd-4a27-b259-0e86b2286a1d tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "cinder-quobyte-bba17fe1-ed85-49b0-a721-4b44b936d150" released by "delete_snapshot" :: held 3.013s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:57:23 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-a8377e88-67cd-4a27-b259-0e86b2286a1d tempest-VolumesSnapshotListTestJSON-977426304 None] Created reservations ['4c6e7c8d-0d40-4c4e-ad05-64a26ee37796', '054a7ddc-e5d0-4b60-bc99-e466b2e26fc0', '3f284c48-1da4-4b70-815a-680950f840ee', 'fc74b291-3c75-44ef-804e-a2d5dad5e70d'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:57:23 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-a8377e88-67cd-4a27-b259-0e86b2286a1d tempest-VolumesSnapshotListTestJSON-977426304 None] Delete snapshot completed successfully.
Sep 10 11:57:23 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a8377e88-67cd-4a27-b259-0e86b2286a1d tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "cinder-6c2b3c64-081b-4733-8b10-d8468dd24840-delete_snapshot" released by "delete_snapshot" :: held 3.541s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:57:24 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-dfcff5aa-a3f8-4c66-9d39-c771e460464d tempest-VolumesSnapshotListTestJSON-977426304 None] Acquiring lock "cinder-b3c119c6-4f8b-44f9-aa59-537ce529ba9f-delete_snapshot" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:57:24 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-dfcff5aa-a3f8-4c66-9d39-c771e460464d tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "cinder-b3c119c6-4f8b-44f9-aa59-537ce529ba9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:57:24 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-dfcff5aa-a3f8-4c66-9d39-c771e460464d tempest-VolumesSnapshotListTestJSON-977426304 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:57:24 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-dfcff5aa-a3f8-4c66-9d39-c771e460464d tempest-VolumesSnapshotListTestJSON-977426304 None] Acquiring lock "cinder-quobyte-bba17fe1-ed85-49b0-a721-4b44b936d150" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:57:24 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-dfcff5aa-a3f8-4c66-9d39-c771e460464d tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "cinder-quobyte-bba17fe1-ed85-49b0-a721-4b44b936d150" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:57:24 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-dfcff5aa-a3f8-4c66-9d39-c771e460464d tempest-VolumesSnapshotListTestJSON-977426304 None] Acquiring lock "cinder-quobyte-b3c119c6-4f8b-44f9-aa59-537ce529ba9f" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:57:24 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-dfcff5aa-a3f8-4c66-9d39-c771e460464d tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "cinder-quobyte-b3c119c6-4f8b-44f9-aa59-537ce529ba9f" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:57:24 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-dfcff5aa-a3f8-4c66-9d39-c771e460464d tempest-VolumesSnapshotListTestJSON-977426304 None] Deleting offline snapshot b3c119c6-4f8b-44f9-aa59-537ce529ba9f of volume bba17fe1-ed85-49b0-a721-4b44b936d150 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 11:57:24 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-dfcff5aa-a3f8-4c66-9d39-c771e460464d tempest-VolumesSnapshotListTestJSON-977426304 None] snapshot_file for this snap is: volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 11:57:24 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d09fd28-0577-47f1-929e-239bcf3cba3a]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:57:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-dfcff5aa-a3f8-4c66-9d39-c771e460464d tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-dfcff5aa-a3f8-4c66-9d39-c771e460464d tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f" returned: 0 in 0.427s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:25 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-dfcff5aa-a3f8-4c66-9d39-c771e460464d tempest-VolumesSnapshotListTestJSON-977426304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bba17fe1-ed85-49b0-a721-4b44b936d150(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 11:57:25 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f164e41-92e3-4107-94a5-1b4712afa7b7]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:57:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-dfcff5aa-a3f8-4c66-9d39-c771e460464d tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:25 devstack quobyte-client[82616]: System call of process 96194 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:57:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-dfcff5aa-a3f8-4c66-9d39-c771e460464d tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150" returned: 0 in 0.467s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-dfcff5aa-a3f8-4c66-9d39-c771e460464d tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-dfcff5aa-a3f8-4c66-9d39-c771e460464d tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f" returned: 0 in 0.229s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-dfcff5aa-a3f8-4c66-9d39-c771e460464d tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-dfcff5aa-a3f8-4c66-9d39-c771e460464d tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150.b3c119c6-4f8b-44f9-aa59-537ce529ba9f" returned: 0 in 0.086s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:26 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-dfcff5aa-a3f8-4c66-9d39-c771e460464d tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "cinder-quobyte-b3c119c6-4f8b-44f9-aa59-537ce529ba9f" released by "_delete_snapshot" :: held 1.509s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:57:26 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-dfcff5aa-a3f8-4c66-9d39-c771e460464d tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "cinder-quobyte-bba17fe1-ed85-49b0-a721-4b44b936d150" released by "delete_snapshot" :: held 1.553s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:57:26 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-dfcff5aa-a3f8-4c66-9d39-c771e460464d tempest-VolumesSnapshotListTestJSON-977426304 None] Created reservations ['43d56f4e-bfdf-488f-b41a-2c5c75b2ba0d', '9526bec9-ef49-444d-bff6-f920a768ceb3', '87fca449-8885-4ea7-935b-177a7cff4815', '0da443ae-6b56-4954-83f9-2f652cd4d3ba'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:57:26 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-dfcff5aa-a3f8-4c66-9d39-c771e460464d tempest-VolumesSnapshotListTestJSON-977426304 None] Delete snapshot completed successfully.
Sep 10 11:57:26 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-dfcff5aa-a3f8-4c66-9d39-c771e460464d tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "cinder-b3c119c6-4f8b-44f9-aa59-537ce529ba9f-delete_snapshot" released by "delete_snapshot" :: held 2.003s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:57:26 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5a062172-2c8a-4852-b7fd-98412447c689 tempest-VolumesSnapshotListTestJSON-977426304 None] Acquiring lock "cinder-bba17fe1-ed85-49b0-a721-4b44b936d150-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:57:26 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5a062172-2c8a-4852-b7fd-98412447c689 tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "cinder-bba17fe1-ed85-49b0-a721-4b44b936d150-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:57:27 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-5a062172-2c8a-4852-b7fd-98412447c689 tempest-VolumesSnapshotListTestJSON-977426304 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:57:27 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5a062172-2c8a-4852-b7fd-98412447c689 tempest-VolumesSnapshotListTestJSON-977426304 None] Acquiring lock "cinder-quobyte-bba17fe1-ed85-49b0-a721-4b44b936d150" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:57:27 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5a062172-2c8a-4852-b7fd-98412447c689 tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "cinder-quobyte-bba17fe1-ed85-49b0-a721-4b44b936d150" acquired by "delete_volume" :: waited 0.027s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:57:27 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a9da8e-8a25-4a74-99a0-82622461e8f0]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:57:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5a062172-2c8a-4852-b7fd-98412447c689 tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5a062172-2c8a-4852-b7fd-98412447c689 tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150" returned: 0 in 0.453s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5a062172-2c8a-4852-b7fd-98412447c689 tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5a062172-2c8a-4852-b7fd-98412447c689 tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-bba17fe1-ed85-49b0-a721-4b44b936d150" returned: 0 in 0.144s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:27 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5a062172-2c8a-4852-b7fd-98412447c689 tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "cinder-quobyte-bba17fe1-ed85-49b0-a721-4b44b936d150" released by "delete_volume" :: held 0.798s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:57:28 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-5a062172-2c8a-4852-b7fd-98412447c689 tempest-VolumesSnapshotListTestJSON-977426304 None] Created reservations ['ed94fc96-96c2-4045-afe4-2a17ce06a72e', '50fe5199-508b-409b-9425-6a69e0427689', '1947d182-1615-4338-88b1-2c0331ce1294', '63abba1c-7df4-4aeb-a783-4a3457177b9b'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:57:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5a062172-2c8a-4852-b7fd-98412447c689 tempest-VolumesSnapshotListTestJSON-977426304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:57:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5a062172-2c8a-4852-b7fd-98412447c689 tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:57:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5a062172-2c8a-4852-b7fd-98412447c689 tempest-VolumesSnapshotListTestJSON-977426304 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:57:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5a062172-2c8a-4852-b7fd-98412447c689 tempest-VolumesSnapshotListTestJSON-977426304 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:57:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5a062172-2c8a-4852-b7fd-98412447c689 tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:57:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5a062172-2c8a-4852-b7fd-98412447c689 tempest-VolumesSnapshotListTestJSON-977426304 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:57:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5a062172-2c8a-4852-b7fd-98412447c689 tempest-VolumesSnapshotListTestJSON-977426304 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.097s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:57:28 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-5a062172-2c8a-4852-b7fd-98412447c689 tempest-VolumesSnapshotListTestJSON-977426304 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:57:28 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-5a062172-2c8a-4852-b7fd-98412447c689 tempest-VolumesSnapshotListTestJSON-977426304 None] Deleted volume successfully.
Sep 10 11:57:28 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5a062172-2c8a-4852-b7fd-98412447c689 tempest-VolumesSnapshotListTestJSON-977426304 None] Lock "cinder-bba17fe1-ed85-49b0-a721-4b44b936d150-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:57:38 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=35,cinder:INSERT=14,cinder:UPDATE=39,cinder:DELETE=3 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:57:38 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=23,cinder:UPDATE=36,cinder:INSERT=6,cinder:DELETE=3 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:58:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-4502d8c0-7300-468a-9e72-1eea58b9458f req-94ee6401-62d9-4aa6-9e54-ab53ad47b7d7 tempest-TestServerVolumeAttachmentScenario-768493754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:58:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-4502d8c0-7300-468a-9e72-1eea58b9458f req-94ee6401-62d9-4aa6-9e54-ab53ad47b7d7 tempest-TestServerVolumeAttachmentScenario-768493754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:58:14 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5501d0-9b3c-48d2-9f6c-a84932fac8df]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:58:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-4502d8c0-7300-468a-9e72-1eea58b9458f req-94ee6401-62d9-4aa6-9e54-ab53ad47b7d7 tempest-TestServerVolumeAttachmentScenario-768493754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-94f05be0-716d-4d4c-b720-46e90a17a17a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:58:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-4502d8c0-7300-468a-9e72-1eea58b9458f req-94ee6401-62d9-4aa6-9e54-ab53ad47b7d7 tempest-TestServerVolumeAttachmentScenario-768493754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-94f05be0-716d-4d4c-b720-46e90a17a17a" returned: 0 in 0.471s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:58:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-4502d8c0-7300-468a-9e72-1eea58b9458f req-94ee6401-62d9-4aa6-9e54-ab53ad47b7d7 tempest-TestServerVolumeAttachmentScenario-768493754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.555s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:58:14 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-4502d8c0-7300-468a-9e72-1eea58b9458f req-94ee6401-62d9-4aa6-9e54-ab53ad47b7d7 tempest-TestServerVolumeAttachmentScenario-768493754 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56', 'name': 'volume-94f05be0-716d-4d4c-b720-46e90a17a17a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5797ce6d-92ec-4746-a913-5b78bd95b105', 'enforce_multipath': True} {{(pid=82594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 11:58:14 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-4502d8c0-7300-468a-9e72-1eea58b9458f req-94ee6401-62d9-4aa6-9e54-ab53ad47b7d7 tempest-TestServerVolumeAttachmentScenario-768493754 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:58:15 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-4502d8c0-7300-468a-9e72-1eea58b9458f req-94ee6401-62d9-4aa6-9e54-ab53ad47b7d7 tempest-TestServerVolumeAttachmentScenario-768493754 None] attachment_update completed successfully.
Sep 10 11:58:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:58:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:58:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:58:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:58:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:58:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:58:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:58:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.391s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:58:23 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:58:25 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=2,cinder:SELECT=4 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:58:25 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:58:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-df861a7a-37b5-4265-b5da-23ead372fff9 req-d6ddd8b6-b197-415a-be7c-841b563de24e tempest-TestServerVolumeAttachmentScenario-768493754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:58:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-df861a7a-37b5-4265-b5da-23ead372fff9 req-d6ddd8b6-b197-415a-be7c-841b563de24e tempest-TestServerVolumeAttachmentScenario-768493754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:58:34 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ac6859-202e-4485-9ead-32b05e09a299]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:58:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-df861a7a-37b5-4265-b5da-23ead372fff9 req-d6ddd8b6-b197-415a-be7c-841b563de24e tempest-TestServerVolumeAttachmentScenario-768493754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f88b3495-f92c-4f3e-a6ff-4869d186b5f5 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:58:35 devstack quobyte-client[82616]: System call of process 96850 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 11:58:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-df861a7a-37b5-4265-b5da-23ead372fff9 req-d6ddd8b6-b197-415a-be7c-841b563de24e tempest-TestServerVolumeAttachmentScenario-768493754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f88b3495-f92c-4f3e-a6ff-4869d186b5f5" returned: 0 in 0.924s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:58:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-df861a7a-37b5-4265-b5da-23ead372fff9 req-d6ddd8b6-b197-415a-be7c-841b563de24e tempest-TestServerVolumeAttachmentScenario-768493754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:58:35 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-df861a7a-37b5-4265-b5da-23ead372fff9 req-d6ddd8b6-b197-415a-be7c-841b563de24e tempest-TestServerVolumeAttachmentScenario-768493754 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56', 'name': 'volume-f88b3495-f92c-4f3e-a6ff-4869d186b5f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bbef8d86-56b3-49c0-8056-2ed7ec1572a6', 'enforce_multipath': True} {{(pid=82594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 11:58:35 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-df861a7a-37b5-4265-b5da-23ead372fff9 req-d6ddd8b6-b197-415a-be7c-841b563de24e tempest-TestServerVolumeAttachmentScenario-768493754 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:58:36 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-df861a7a-37b5-4265-b5da-23ead372fff9 req-d6ddd8b6-b197-415a-be7c-841b563de24e tempest-TestServerVolumeAttachmentScenario-768493754 None] attachment_update completed successfully.
Sep 10 11:58:46 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:58:46 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=6 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:59:04 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-02b4d696-b68e-40b7-8082-cd1b3ae17f54 req-14612de0-0787-45c4-a3be-2b2e0c289792 tempest-TestServerVolumeAttachmentScenario-768493754 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:59:04 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-02b4d696-b68e-40b7-8082-cd1b3ae17f54 req-14612de0-0787-45c4-a3be-2b2e0c289792 tempest-TestServerVolumeAttachmentScenario-768493754 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:59:04 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-02b4d696-b68e-40b7-8082-cd1b3ae17f54 req-14612de0-0787-45c4-a3be-2b2e0c289792 tempest-TestServerVolumeAttachmentScenario-768493754 None] Terminate volume connection completed successfully.
Sep 10 11:59:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-02b4d696-b68e-40b7-8082-cd1b3ae17f54 req-14612de0-0787-45c4-a3be-2b2e0c289792 tempest-TestServerVolumeAttachmentScenario-768493754 None] Deleting attachment bbef8d86-56b3-49c0-8056-2ed7ec1572a6. {{(pid=82594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 11:59:14 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:59:14 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:59:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 11:59:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:59:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:59:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:59:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:59:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:59:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:59:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.230s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:59:23 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:59:28 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-42d8910c-3005-4414-92fb-59dcfe1e0472 req-9740c0ee-8865-4c15-b9a2-4f75a2215aeb tempest-TestServerVolumeAttachmentScenario-768493754 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:59:29 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-42d8910c-3005-4414-92fb-59dcfe1e0472 req-9740c0ee-8865-4c15-b9a2-4f75a2215aeb tempest-TestServerVolumeAttachmentScenario-768493754 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:59:29 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-42d8910c-3005-4414-92fb-59dcfe1e0472 req-9740c0ee-8865-4c15-b9a2-4f75a2215aeb tempest-TestServerVolumeAttachmentScenario-768493754 None] Terminate volume connection completed successfully.
Sep 10 11:59:29 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-42d8910c-3005-4414-92fb-59dcfe1e0472 req-9740c0ee-8865-4c15-b9a2-4f75a2215aeb tempest-TestServerVolumeAttachmentScenario-768493754 None] Deleting attachment 5797ce6d-92ec-4746-a913-5b78bd95b105. {{(pid=82594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 11:59:38 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:59:38 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 11:59:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Flow 'volume_create_manager' (6f5e9a47-99ae-4b8e-a803-da95b1872ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:59:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d4e108-953a-493a-a7e1-76c07e0a8603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:59:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d4e108-953a-493a-a7e1-76c07e0a8603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-997086715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c827add-3575-41dc-bbca-bd638c68c6bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38d91b4c1b734550ab1e1e9deb1b0910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:59:38Z,use_quota=True,user_id='d67316a2939f47ca98deb8c1393bd5ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:59:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05239635-c372-4ad1-9f6a-56ab7a311ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:59:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05239635-c372-4ad1-9f6a-56ab7a311ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:59:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65f8596-799f-401d-b734-89c748209f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:59:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65f8596-799f-401d-b734-89c748209f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c827add-3575-41dc-bbca-bd638c68c6bf', 'volume_name': 'volume-7c827add-3575-41dc-bbca-bd638c68c6bf', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:59:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d11ef0-2230-408a-b862-dd9268fb23ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:59:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d11ef0-2230-408a-b862-dd9268fb23ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:59:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6519daa-0d37-4740-bb1a-9487915f3255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:59:38 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Volume 7c827add-3575-41dc-bbca-bd638c68c6bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c827add-3575-41dc-bbca-bd638c68c6bf', 'volume_size': 1}
Sep 10 11:59:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:59:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:59:38 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T09:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-997086715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c827add-3575-41dc-bbca-bd638c68c6bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38d91b4c1b734550ab1e1e9deb1b0910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T09:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T09:59:38Z,use_quota=True,user_id='d67316a2939f47ca98deb8c1393bd5ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 11:59:38 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Creating volume 7c827add-3575-41dc-bbca-bd638c68c6bf {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 11:59:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:59:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:59:38 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:59:38 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:59:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:59:38 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 11:59:38 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 11:59:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c827add-3575-41dc-bbca-bd638c68c6bf 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:59:38 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=116, name=volume-7c827add-3575-41dc-bbca-bd638c68c6bf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 11:59:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c827add-3575-41dc-bbca-bd638c68c6bf 1073741824" returned: 0 in 0.431s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:59:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c827add-3575-41dc-bbca-bd638c68c6bf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:59:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c827add-3575-41dc-bbca-bd638c68c6bf" returned: 0 in 0.132s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:59:39 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] <== create_volume: return (631ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 11:59:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.645s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:59:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6519daa-0d37-4740-bb1a-9487915f3255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c827add-3575-41dc-bbca-bd638c68c6bf', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:59:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af0ace0-c1a9-446e-a8dd-471b2e688ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 11:59:39 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Volume volume-7c827add-3575-41dc-bbca-bd638c68c6bf (7c827add-3575-41dc-bbca-bd638c68c6bf): created successfully
Sep 10 11:59:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af0ace0-c1a9-446e-a8dd-471b2e688ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 11:59:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Flow 'volume_create_manager' (6f5e9a47-99ae-4b8e-a803-da95b1872ac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 11:59:39 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-d31e1dc6-ff99-4a30-88a2-ea0f7aa27ba3 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Created volume successfully.
Sep 10 11:59:42 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1c95c8ad-0598-4c14-a331-ef1166e0f746 tempest-TestServerVolumeAttachmentScenario-768493754 None] Acquiring lock "cinder-f88b3495-f92c-4f3e-a6ff-4869d186b5f5-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:59:42 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1c95c8ad-0598-4c14-a331-ef1166e0f746 tempest-TestServerVolumeAttachmentScenario-768493754 None] Lock "cinder-f88b3495-f92c-4f3e-a6ff-4869d186b5f5-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:59:42 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-1c95c8ad-0598-4c14-a331-ef1166e0f746 tempest-TestServerVolumeAttachmentScenario-768493754 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:59:42 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1c95c8ad-0598-4c14-a331-ef1166e0f746 tempest-TestServerVolumeAttachmentScenario-768493754 None] Acquiring lock "cinder-quobyte-f88b3495-f92c-4f3e-a6ff-4869d186b5f5" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:59:42 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1c95c8ad-0598-4c14-a331-ef1166e0f746 tempest-TestServerVolumeAttachmentScenario-768493754 None] Lock "cinder-quobyte-f88b3495-f92c-4f3e-a6ff-4869d186b5f5" acquired by "delete_volume" :: waited 0.014s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:59:42 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[515324d6-da31-4c24-aa00-a052a49b7370]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:59:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1c95c8ad-0598-4c14-a331-ef1166e0f746 tempest-TestServerVolumeAttachmentScenario-768493754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f88b3495-f92c-4f3e-a6ff-4869d186b5f5 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:59:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1c95c8ad-0598-4c14-a331-ef1166e0f746 tempest-TestServerVolumeAttachmentScenario-768493754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f88b3495-f92c-4f3e-a6ff-4869d186b5f5" returned: 0 in 0.484s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:59:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1c95c8ad-0598-4c14-a331-ef1166e0f746 tempest-TestServerVolumeAttachmentScenario-768493754 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f88b3495-f92c-4f3e-a6ff-4869d186b5f5 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:59:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1c95c8ad-0598-4c14-a331-ef1166e0f746 tempest-TestServerVolumeAttachmentScenario-768493754 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f88b3495-f92c-4f3e-a6ff-4869d186b5f5" returned: 0 in 0.084s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:59:43 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1c95c8ad-0598-4c14-a331-ef1166e0f746 tempest-TestServerVolumeAttachmentScenario-768493754 None] Lock "cinder-quobyte-f88b3495-f92c-4f3e-a6ff-4869d186b5f5" released by "delete_volume" :: held 0.712s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:59:43 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-1c95c8ad-0598-4c14-a331-ef1166e0f746 tempest-TestServerVolumeAttachmentScenario-768493754 None] Created reservations ['b95b9df5-8b14-4bea-8239-8ffe3385cab7', '582c5fc7-0a44-4990-a14d-d1d5921fe9e7', 'c575ff7b-381f-4790-ae8d-9596a9ddfa97', '4b2957d1-c63b-4608-bb70-f6e178e8cc17'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:59:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1c95c8ad-0598-4c14-a331-ef1166e0f746 tempest-TestServerVolumeAttachmentScenario-768493754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:59:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1c95c8ad-0598-4c14-a331-ef1166e0f746 tempest-TestServerVolumeAttachmentScenario-768493754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:59:43 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1c95c8ad-0598-4c14-a331-ef1166e0f746 tempest-TestServerVolumeAttachmentScenario-768493754 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:59:43 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1c95c8ad-0598-4c14-a331-ef1166e0f746 tempest-TestServerVolumeAttachmentScenario-768493754 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:59:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1c95c8ad-0598-4c14-a331-ef1166e0f746 tempest-TestServerVolumeAttachmentScenario-768493754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:59:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1c95c8ad-0598-4c14-a331-ef1166e0f746 tempest-TestServerVolumeAttachmentScenario-768493754 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:59:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1c95c8ad-0598-4c14-a331-ef1166e0f746 tempest-TestServerVolumeAttachmentScenario-768493754 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.119s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:59:43 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-1c95c8ad-0598-4c14-a331-ef1166e0f746 tempest-TestServerVolumeAttachmentScenario-768493754 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:59:43 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-1c95c8ad-0598-4c14-a331-ef1166e0f746 tempest-TestServerVolumeAttachmentScenario-768493754 None] Deleted volume successfully.
Sep 10 11:59:44 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1c95c8ad-0598-4c14-a331-ef1166e0f746 tempest-TestServerVolumeAttachmentScenario-768493754 None] Lock "cinder-f88b3495-f92c-4f3e-a6ff-4869d186b5f5-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:59:44 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-c72d0f23-ce5d-44cf-8c67-6317475b719b tempest-TestServerVolumeAttachmentScenario-768493754 None] Acquiring lock "cinder-94f05be0-716d-4d4c-b720-46e90a17a17a-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:59:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-ca548de7-d183-46de-b8bf-4c112c468879 req-e73e6268-0d4c-48a6-abfe-71f3286d1d27 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:59:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-ca548de7-d183-46de-b8bf-4c112c468879 req-e73e6268-0d4c-48a6-abfe-71f3286d1d27 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:59:44 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddad390-4c9f-4040-b314-3f0bfc4c24cd]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:59:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-ca548de7-d183-46de-b8bf-4c112c468879 req-e73e6268-0d4c-48a6-abfe-71f3286d1d27 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c827add-3575-41dc-bbca-bd638c68c6bf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:59:44 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-c72d0f23-ce5d-44cf-8c67-6317475b719b tempest-TestServerVolumeAttachmentScenario-768493754 None] Lock "cinder-94f05be0-716d-4d4c-b720-46e90a17a17a-delete_volume" acquired by "delete_volume" :: waited 0.155s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:59:44 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-c72d0f23-ce5d-44cf-8c67-6317475b719b tempest-TestServerVolumeAttachmentScenario-768493754 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:59:44 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-c72d0f23-ce5d-44cf-8c67-6317475b719b tempest-TestServerVolumeAttachmentScenario-768493754 None] Acquiring lock "cinder-quobyte-94f05be0-716d-4d4c-b720-46e90a17a17a" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 11:59:45 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-c72d0f23-ce5d-44cf-8c67-6317475b719b tempest-TestServerVolumeAttachmentScenario-768493754 None] Lock "cinder-quobyte-94f05be0-716d-4d4c-b720-46e90a17a17a" acquired by "delete_volume" :: waited 0.034s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 11:59:45 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8b8fa9-0288-41cf-8e6e-83fa9b6e72bc]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 11:59:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c72d0f23-ce5d-44cf-8c67-6317475b719b tempest-TestServerVolumeAttachmentScenario-768493754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-94f05be0-716d-4d4c-b720-46e90a17a17a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:59:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-ca548de7-d183-46de-b8bf-4c112c468879 req-e73e6268-0d4c-48a6-abfe-71f3286d1d27 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c827add-3575-41dc-bbca-bd638c68c6bf" returned: 0 in 0.627s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:59:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-ca548de7-d183-46de-b8bf-4c112c468879 req-e73e6268-0d4c-48a6-abfe-71f3286d1d27 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.683s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:59:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-ca548de7-d183-46de-b8bf-4c112c468879 req-e73e6268-0d4c-48a6-abfe-71f3286d1d27 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56', 'name': 'volume-7c827add-3575-41dc-bbca-bd638c68c6bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b2801354-17c7-46fa-850d-18d928833562', 'enforce_multipath': True} {{(pid=82594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 11:59:45 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-ca548de7-d183-46de-b8bf-4c112c468879 req-e73e6268-0d4c-48a6-abfe-71f3286d1d27 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 11:59:45 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-ca548de7-d183-46de-b8bf-4c112c468879 req-e73e6268-0d4c-48a6-abfe-71f3286d1d27 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] attachment_update completed successfully.
Sep 10 11:59:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c72d0f23-ce5d-44cf-8c67-6317475b719b tempest-TestServerVolumeAttachmentScenario-768493754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-94f05be0-716d-4d4c-b720-46e90a17a17a" returned: 0 in 0.566s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:59:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c72d0f23-ce5d-44cf-8c67-6317475b719b tempest-TestServerVolumeAttachmentScenario-768493754 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-94f05be0-716d-4d4c-b720-46e90a17a17a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:59:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c72d0f23-ce5d-44cf-8c67-6317475b719b tempest-TestServerVolumeAttachmentScenario-768493754 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-94f05be0-716d-4d4c-b720-46e90a17a17a" returned: 0 in 0.144s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:59:45 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-c72d0f23-ce5d-44cf-8c67-6317475b719b tempest-TestServerVolumeAttachmentScenario-768493754 None] Lock "cinder-quobyte-94f05be0-716d-4d4c-b720-46e90a17a17a" released by "delete_volume" :: held 0.800s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:59:46 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-c72d0f23-ce5d-44cf-8c67-6317475b719b tempest-TestServerVolumeAttachmentScenario-768493754 None] Created reservations ['a8d73c14-4527-4da7-856e-7bf40a9ae83c', '30e0f044-9f0b-4a1c-82a0-a4f197bb1f7b', '3448ecd9-b095-4381-b38f-a5a8ae251023', 'edbc68b4-793c-4e4c-b40d-9e449cc74b65'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 11:59:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-c72d0f23-ce5d-44cf-8c67-6317475b719b tempest-TestServerVolumeAttachmentScenario-768493754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 11:59:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-c72d0f23-ce5d-44cf-8c67-6317475b719b tempest-TestServerVolumeAttachmentScenario-768493754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 11:59:46 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-c72d0f23-ce5d-44cf-8c67-6317475b719b tempest-TestServerVolumeAttachmentScenario-768493754 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 11:59:46 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-c72d0f23-ce5d-44cf-8c67-6317475b719b tempest-TestServerVolumeAttachmentScenario-768493754 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 11:59:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-c72d0f23-ce5d-44cf-8c67-6317475b719b tempest-TestServerVolumeAttachmentScenario-768493754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 11:59:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c72d0f23-ce5d-44cf-8c67-6317475b719b tempest-TestServerVolumeAttachmentScenario-768493754 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 11:59:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c72d0f23-ce5d-44cf-8c67-6317475b719b tempest-TestServerVolumeAttachmentScenario-768493754 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.099s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 11:59:46 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-c72d0f23-ce5d-44cf-8c67-6317475b719b tempest-TestServerVolumeAttachmentScenario-768493754 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 11:59:46 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-c72d0f23-ce5d-44cf-8c67-6317475b719b tempest-TestServerVolumeAttachmentScenario-768493754 None] Deleted volume successfully.
Sep 10 11:59:46 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-c72d0f23-ce5d-44cf-8c67-6317475b719b tempest-TestServerVolumeAttachmentScenario-768493754 None] Lock "cinder-94f05be0-716d-4d4c-b720-46e90a17a17a-delete_volume" released by "delete_volume" :: held 2.135s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 11:59:56 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=18,cinder:UPDATE=14,cinder:INSERT=6,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 11:59:56 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=17,cinder:UPDATE=25,cinder:DELETE=2,cinder:INSERT=2 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 12:00:16 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 12:00:16 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-6f3e91c3-36a5-4ca3-9348-2e33c1217c15 req-2b64f28f-0c94-4902-b467-96377c4fd211 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:00:16 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-6f3e91c3-36a5-4ca3-9348-2e33c1217c15 req-2b64f28f-0c94-4902-b467-96377c4fd211 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:00:16 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-6f3e91c3-36a5-4ca3-9348-2e33c1217c15 req-2b64f28f-0c94-4902-b467-96377c4fd211 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Terminate volume connection completed successfully.
Sep 10 12:00:16 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-6f3e91c3-36a5-4ca3-9348-2e33c1217c15 req-2b64f28f-0c94-4902-b467-96377c4fd211 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Deleting attachment b2801354-17c7-46fa-850d-18d928833562. {{(pid=82594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 12:00:18 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e693b52f-e681-4b50-b774-f1d972fd20d4 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Acquiring lock "cinder-7c827add-3575-41dc-bbca-bd638c68c6bf-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:00:18 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e693b52f-e681-4b50-b774-f1d972fd20d4 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Lock "cinder-7c827add-3575-41dc-bbca-bd638c68c6bf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:00:18 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-e693b52f-e681-4b50-b774-f1d972fd20d4 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:00:18 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e693b52f-e681-4b50-b774-f1d972fd20d4 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Acquiring lock "cinder-quobyte-7c827add-3575-41dc-bbca-bd638c68c6bf" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:00:18 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e693b52f-e681-4b50-b774-f1d972fd20d4 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Lock "cinder-quobyte-7c827add-3575-41dc-bbca-bd638c68c6bf" acquired by "delete_volume" :: waited 0.019s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:00:18 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c38fb0-3da6-4e2a-9615-7af0181703f4]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:00:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e693b52f-e681-4b50-b774-f1d972fd20d4 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c827add-3575-41dc-bbca-bd638c68c6bf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:00:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e693b52f-e681-4b50-b774-f1d972fd20d4 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c827add-3575-41dc-bbca-bd638c68c6bf" returned: 0 in 0.564s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:00:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e693b52f-e681-4b50-b774-f1d972fd20d4 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c827add-3575-41dc-bbca-bd638c68c6bf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:00:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e693b52f-e681-4b50-b774-f1d972fd20d4 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c827add-3575-41dc-bbca-bd638c68c6bf" returned: 0 in 0.095s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:00:19 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e693b52f-e681-4b50-b774-f1d972fd20d4 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Lock "cinder-quobyte-7c827add-3575-41dc-bbca-bd638c68c6bf" released by "delete_volume" :: held 0.826s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:00:19 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-e693b52f-e681-4b50-b774-f1d972fd20d4 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Created reservations ['c0ffbd0c-28b0-415e-aaeb-41bd4f492577', 'e3bf3f4e-9b12-4c8c-a4e8-27fbae585a9b', 'da4c8f61-ee64-4ceb-88bf-36d6e5459df7', '949d54e5-b929-4482-9967-5ebb40e00dc2'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:00:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e693b52f-e681-4b50-b774-f1d972fd20d4 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:00:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e693b52f-e681-4b50-b774-f1d972fd20d4 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:00:20 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e693b52f-e681-4b50-b774-f1d972fd20d4 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:00:20 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e693b52f-e681-4b50-b774-f1d972fd20d4 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:00:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e693b52f-e681-4b50-b774-f1d972fd20d4 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:00:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e693b52f-e681-4b50-b774-f1d972fd20d4 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:00:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e693b52f-e681-4b50-b774-f1d972fd20d4 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.128s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:00:20 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-e693b52f-e681-4b50-b774-f1d972fd20d4 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:00:20 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-e693b52f-e681-4b50-b774-f1d972fd20d4 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Deleted volume successfully.
Sep 10 12:00:20 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e693b52f-e681-4b50-b774-f1d972fd20d4 tempest-TestServerVolumeAttachScenarioOldVersion-1409691032 None] Lock "cinder-7c827add-3575-41dc-bbca-bd638c68c6bf-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:00:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 12:00:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:00:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:00:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:00:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:00:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:00:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:00:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.496s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:00:23 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:00:30 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=4,cinder:UPDATE=11,cinder:INSERT=4 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 12:00:30 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=8,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 12:00:42 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:00:42 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:00:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Flow 'volume_create_manager' (de2a946d-34f4-4ef6-8a7b-44417357d67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:00:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3252d3-bc80-4384-a2af-f7305eabe127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:00:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3252d3-bc80-4384-a2af-f7305eabe127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1929039333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db0fc41f-cc75-46c3-ae10-60b05607d7b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e03331202e4b7e95595349eddf26f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:00:42Z,use_quota=True,user_id='1b8688d5188241f2a0d60fe94f9c0053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:00:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a935196-37ed-4cd3-8bd8-b41295db2ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:00:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a935196-37ed-4cd3-8bd8-b41295db2ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:00:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d1a2cdf-a7b3-46e1-bf98-19b8011d9bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:00:43 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d1a2cdf-a7b3-46e1-bf98-19b8011d9bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'db0fc41f-cc75-46c3-ae10-60b05607d7b9', 'volume_name': 'volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9', 'volume_size': 1, 'image_id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee56e2a9864a4b70aa312dea5a262bbd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'created_at': datetime.datetime(2025, 9, 10, 9, 15, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 9, 15, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39a0ac1b-5093-4de2-911f-205906a7575b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4f51cf0fd0>}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:00:43 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d714f9c3-9ddd-4c03-9c1b-784214320733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:00:43 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d714f9c3-9ddd-4c03-9c1b-784214320733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:00:43 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b75bdb50-2082-46f8-84c6-319859cf88b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:00:43 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Volume db0fc41f-cc75-46c3-ae10-60b05607d7b9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9', 'volume_size': 1, 'image_id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee56e2a9864a4b70aa312dea5a262bbd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'created_at': datetime.datetime(2025, 9, 10, 9, 15, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 9, 15, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39a0ac1b-5093-4de2-911f-205906a7575b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4f51cf0fd0>}
Sep 10 12:00:43 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Cloning db0fc41f-cc75-46c3-ae10-60b05607d7b9 from image 39a0ac1b-5093-4de2-911f-205906a7575b  at location (None, None). {{(pid=82594) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 12:00:43 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_za0lc653devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82594) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 12:00:43 devstack cinder-volume[82594]: INFO cinder.image.image_utils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Image download 20.69 MB at 20.69 MB/s
Sep 10 12:00:43 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b437380-5e8f-4adb-9fa0-fe318cf97275]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:00:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_za0lc653devstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:00:44 devstack sudo[97607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_za0lc653devstack@QuobyteHD
Sep 10 12:00:44 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 12:00:46 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root
Sep 10 12:00:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_za0lc653devstack@QuobyteHD" returned: 0 in 2.312s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:00:46 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Temporary image 39a0ac1b-5093-4de2-911f-205906a7575b is fetched for user 1b8688d5188241f2a0d60fe94f9c0053. {{(pid=82594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 12:00:46 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9582f498-0b45-442d-995d-d4cf8c89b3a1]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:00:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_za0lc653devstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:00:47 devstack sudo[97613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_za0lc653devstack@QuobyteHD
Sep 10 12:00:47 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 12:00:49 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root
Sep 10 12:00:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_za0lc653devstack@QuobyteHD" returned: 0 in 2.679s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:00:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:00:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:00:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1929039333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db0fc41f-cc75-46c3-ae10-60b05607d7b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e03331202e4b7e95595349eddf26f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:00:42Z,use_quota=True,user_id='1b8688d5188241f2a0d60fe94f9c0053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:00:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Creating volume db0fc41f-cc75-46c3-ae10-60b05607d7b9 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:00:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:00:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:00:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:00:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:00:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:00:49 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:00:49 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:00:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:00:49 devstack quobyte-client[82616]: System call of process 97619 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:00:49 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=117, name=volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:00:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9 1073741824" returned: 0 in 0.432s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:00:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:00:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9" returned: 0 in 0.131s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:00:50 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] <== create_volume: return (666ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:00:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:00:50 devstack cinder-volume[82594]: DEBUG cinder.volume.volume_utils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Attempting download of 39a0ac1b-5093-4de2-911f-205906a7575b ((None, None)) to volume db0fc41f-cc75-46c3-ae10-60b05607d7b9. {{(pid=82594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 12:00:50 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[28401955-0700-4060-8034-68a56919bf16]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:00:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_39a0ac1b-5093-4de2-911f-205906a7575b_1wdw54tq {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:00:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_39a0ac1b-5093-4de2-911f-205906a7575b_1wdw54tq" returned: 0 in 0.644s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:00:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39a0ac1b-5093-4de2-911f-205906a7575b_1wdw54tq {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:00:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39a0ac1b-5093-4de2-911f-205906a7575b_1wdw54tq" returned: 1 in 0.524s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:00:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39a0ac1b-5093-4de2-911f-205906a7575b_1wdw54tq' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 12:00:51 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[42197ea9-0269-44c7-a93c-e126efd9c273]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:00:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_za0lc653devstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:00:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_za0lc653devstack@QuobyteHD" returned: 0 in 0.475s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:00:52 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] 39a0ac1b-5093-4de2-911f-205906a7575b was qcow2, converting to raw {{(pid=82594) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 12:00:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_za0lc653devstack@QuobyteHD /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:00:52 devstack quobyte-client[82616]: System call of process 97632 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:00:52 devstack quobyte-client[82616]: System call of process 97632 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:00:52 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=117, name=volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:00:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_za0lc653devstack@QuobyteHD /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9" returned: 0 in 1.406s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:00:53 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_39a0ac1b-5093-4de2-911f-205906a7575b_za0lc653devstack@QuobyteHD, size 112.00 MB, duration 1.45 sec, destination /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9 {{(pid=82594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 12:00:53 devstack cinder-volume[82594]: INFO cinder.image.image_utils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Converted 112.00 MB image at 77.33 MB/s
Sep 10 12:00:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:00:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9 1G" returned: 0 in 0.176s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:00:54 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a72ebe1-f5bc-4142-8b33-65b62835712e]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:00:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:00:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9" returned: 0 in 0.464s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:00:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:00:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9" returned: 1 in 0.428s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:00:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 12:00:55 devstack cinder-volume[82594]: DEBUG cinder.volume.volume_utils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Downloaded image 39a0ac1b-5093-4de2-911f-205906a7575b ((None, None)) to volume db0fc41f-cc75-46c3-ae10-60b05607d7b9 successfully. {{(pid=82594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 12:00:55 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Temporary image 39a0ac1b-5093-4de2-911f-205906a7575b for user 1b8688d5188241f2a0d60fe94f9c0053 is deleted. {{(pid=82594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 12:00:55 devstack cinder-volume[82594]: DEBUG cinder.volume.volume_utils [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Marking volume db0fc41f-cc75-46c3-ae10-60b05607d7b9 as bootable. {{(pid=82594) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 12:00:55 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Copying metadata from image 39a0ac1b-5093-4de2-911f-205906a7575b to db0fc41f-cc75-46c3-ae10-60b05607d7b9. {{(pid=82594) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 12:00:55 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Creating volume glance metadata for volume db0fc41f-cc75-46c3-ae10-60b05607d7b9 backed by image 39a0ac1b-5093-4de2-911f-205906a7575b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82594) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 12:00:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b75bdb50-2082-46f8-84c6-319859cf88b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9', 'volume_size': 1, 'image_id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee56e2a9864a4b70aa312dea5a262bbd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '39a0ac1b-5093-4de2-911f-205906a7575b', 'created_at': datetime.datetime(2025, 9, 10, 9, 15, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 9, 15, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39a0ac1b-5093-4de2-911f-205906a7575b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4f51cf0fd0>}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:00:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a7a8fa-1f44-4fb5-bfa1-0f7b12d02c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:00:55 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Volume volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9 (db0fc41f-cc75-46c3-ae10-60b05607d7b9): created successfully
Sep 10 12:00:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a7a8fa-1f44-4fb5-bfa1-0f7b12d02c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:00:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Flow 'volume_create_manager' (de2a946d-34f4-4ef6-8a7b-44417357d67d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:00:55 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-0eeb2eaf-7745-4728-922a-d78f7816e445 tempest-TestShelveInstance-527094388 None] Created volume successfully.
Sep 10 12:00:57 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:00:57 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:00:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Flow 'volume_create_manager' (639fe63e-0634-439d-b44f-6e67fae90cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:00:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95788aaa-1d37-462d-ba38-96ed7b80c99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:00:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95788aaa-1d37-462d-ba38-96ed7b80c99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-736172343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a713fc36-3dad-4953-a49c-7f2e422ce3ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eacaf6e343844cdad5ed53f7b6710f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:00:58Z,use_quota=True,user_id='0c0d12f6214c465083d314fd213c976e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:00:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (447e9634-9d82-4330-ad40-1668e8af0da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:00:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (447e9634-9d82-4330-ad40-1668e8af0da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:00:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (394a7b75-3ba1-43af-9754-0ecbbeec9604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:00:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (394a7b75-3ba1-43af-9754-0ecbbeec9604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a713fc36-3dad-4953-a49c-7f2e422ce3ed', 'volume_name': 'volume-a713fc36-3dad-4953-a49c-7f2e422ce3ed', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:00:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e401bed8-5be3-42d5-8aa6-9b92822689a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:00:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e401bed8-5be3-42d5-8aa6-9b92822689a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:00:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4040912-f24e-49c5-b994-4cf6d1a670e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:00:57 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Volume a713fc36-3dad-4953-a49c-7f2e422ce3ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a713fc36-3dad-4953-a49c-7f2e422ce3ed', 'volume_size': 1}
Sep 10 12:00:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:00:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:00:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-736172343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a713fc36-3dad-4953-a49c-7f2e422ce3ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eacaf6e343844cdad5ed53f7b6710f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:00:58Z,use_quota=True,user_id='0c0d12f6214c465083d314fd213c976e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:00:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Creating volume a713fc36-3dad-4953-a49c-7f2e422ce3ed {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:00:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:00:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:00:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:00:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:00:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:00:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:00:57 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:00:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a713fc36-3dad-4953-a49c-7f2e422ce3ed 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:00:58 devstack quobyte-client[82616]: System call of process 97650 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:00:58 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=118, name=volume-a713fc36-3dad-4953-a49c-7f2e422ce3ed, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:00:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a713fc36-3dad-4953-a49c-7f2e422ce3ed 1073741824" returned: 0 in 0.662s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:00:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a713fc36-3dad-4953-a49c-7f2e422ce3ed {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:00:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a713fc36-3dad-4953-a49c-7f2e422ce3ed" returned: 0 in 0.304s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] <== create_volume: return (1035ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:00:59 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Flow 'volume_create_manager' (ae6b77a5-3e80-4bb0-9eef-2abff6171679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dcf225b-1070-48dc-9bf3-fc64fc6316d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dcf225b-1070-48dc-9bf3-fc64fc6316d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1782631385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=490c7f2b-55b9-48c6-9be1-7a434079117a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eacaf6e343844cdad5ed53f7b6710f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:00:58Z,use_quota=True,user_id='0c0d12f6214c465083d314fd213c976e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e811d0-741e-4fee-86a1-7ea813eb5c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e811d0-741e-4fee-86a1-7ea813eb5c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23ee676-1c1f-4beb-90cf-d8671c26b046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23ee676-1c1f-4beb-90cf-d8671c26b046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '490c7f2b-55b9-48c6-9be1-7a434079117a', 'volume_name': 'volume-490c7f2b-55b9-48c6-9be1-7a434079117a', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb5260c5-b8f4-46b9-8b49-c47966c7740c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb5260c5-b8f4-46b9-8b49-c47966c7740c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d87cb4f9-5dbd-4d66-8d3d-1a02284a36cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:00:59 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Volume 490c7f2b-55b9-48c6-9be1-7a434079117a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-490c7f2b-55b9-48c6-9be1-7a434079117a', 'volume_size': 1}
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1782631385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=490c7f2b-55b9-48c6-9be1-7a434079117a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eacaf6e343844cdad5ed53f7b6710f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:00:58Z,use_quota=True,user_id='0c0d12f6214c465083d314fd213c976e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Creating volume 490c7f2b-55b9-48c6-9be1-7a434079117a {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:00:59 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-490c7f2b-55b9-48c6-9be1-7a434079117a 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:00:59 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=119, name=volume-490c7f2b-55b9-48c6-9be1-7a434079117a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:00:59 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Flow 'volume_create_manager' (9a16b5f9-6212-407a-8f4c-3243e2ad84b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:00:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc44cedc-23de-4cba-82fc-11783d8d7762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4040912-f24e-49c5-b994-4cf6d1a670e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a713fc36-3dad-4953-a49c-7f2e422ce3ed', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a998846-5905-4763-ab67-20b61212c3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc44cedc-23de-4cba-82fc-11783d8d7762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1287424009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5385dcbb-516b-40cf-8395-cb772159542e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eacaf6e343844cdad5ed53f7b6710f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:00:59Z,use_quota=True,user_id='0c0d12f6214c465083d314fd213c976e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (277d9b3c-5103-4f20-b537-587603f84f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (277d9b3c-5103-4f20-b537-587603f84f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b6e4e3-cb6a-4ebc-a69b-22ebf9c79fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b6e4e3-cb6a-4ebc-a69b-22ebf9c79fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5385dcbb-516b-40cf-8395-cb772159542e', 'volume_name': 'volume-5385dcbb-516b-40cf-8395-cb772159542e', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c4e0b1-0ac8-4a93-8b00-0ac825574db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c4e0b1-0ac8-4a93-8b00-0ac825574db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2010e737-44a8-4b61-8e44-f4fad615f6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:00 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Volume 5385dcbb-516b-40cf-8395-cb772159542e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5385dcbb-516b-40cf-8395-cb772159542e', 'volume_size': 1}
Sep 10 12:01:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:01:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-490c7f2b-55b9-48c6-9be1-7a434079117a 1073741824" returned: 0 in 0.927s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-490c7f2b-55b9-48c6-9be1-7a434079117a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:00 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Volume volume-a713fc36-3dad-4953-a49c-7f2e422ce3ed (a713fc36-3dad-4953-a49c-7f2e422ce3ed): created successfully
Sep 10 12:01:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a998846-5905-4763-ab67-20b61212c3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Flow 'volume_create_manager' (639fe63e-0634-439d-b44f-6e67fae90cd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:01:00 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:01:00 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:01:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Flow 'volume_create_manager' (6736e6c4-e0cf-4def-82bb-3ce8b827ef7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:01:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad15d461-3036-49e9-b681-9aba15cb0e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-490c7f2b-55b9-48c6-9be1-7a434079117a" returned: 0 in 0.619s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] <== create_volume: return (1567ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:01:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:01:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.666s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:01:01 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1287424009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5385dcbb-516b-40cf-8395-cb772159542e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eacaf6e343844cdad5ed53f7b6710f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:00:59Z,use_quota=True,user_id='0c0d12f6214c465083d314fd213c976e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:01:01 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Creating volume 5385dcbb-516b-40cf-8395-cb772159542e {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:01:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:01:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:01:01 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:01:01 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:01:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:01:01 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:01:01 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:01:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5385dcbb-516b-40cf-8395-cb772159542e 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:01 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-cd199064-8a68-4ee1-b2c7-2e012d404548 tempest-CreateVolumesFromImageTest-372041579 None] Created volume successfully.
Sep 10 12:01:01 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=120, name=volume-5385dcbb-516b-40cf-8395-cb772159542e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:01:01 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:01:01 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:01:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Flow 'volume_create_manager' (a4b1a08e-3c22-4771-95c5-2b7e4ac73215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:01:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3945283-e1ec-4f16-98eb-410d3e86d61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad15d461-3036-49e9-b681-9aba15cb0e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1893044845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b8eb08c-251a-4f5f-a0db-062e4af9efad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eacaf6e343844cdad5ed53f7b6710f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:01:00Z,use_quota=True,user_id='0c0d12f6214c465083d314fd213c976e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513a8260-bbb2-4507-9ccf-aef2e32e624b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513a8260-bbb2-4507-9ccf-aef2e32e624b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79de284b-01d1-4c82-9748-fd24acbcc5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79de284b-01d1-4c82-9748-fd24acbcc5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b8eb08c-251a-4f5f-a0db-062e4af9efad', 'volume_name': 'volume-8b8eb08c-251a-4f5f-a0db-062e4af9efad', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd0a1e12-4e8d-4029-9c39-6a1581f8c326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd0a1e12-4e8d-4029-9c39-6a1581f8c326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:01 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e0ba27-83e1-4295-8a55-2f76da3d3151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:01 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Volume 8b8eb08c-251a-4f5f-a0db-062e4af9efad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b8eb08c-251a-4f5f-a0db-062e4af9efad', 'volume_size': 1}
Sep 10 12:01:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:01:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5385dcbb-516b-40cf-8395-cb772159542e 1073741824" returned: 0 in 0.896s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5385dcbb-516b-40cf-8395-cb772159542e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:02 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d87cb4f9-5dbd-4d66-8d3d-1a02284a36cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-490c7f2b-55b9-48c6-9be1-7a434079117a', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:02 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ea6efd-bfb9-4070-b8a2-0ed1697f6303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:02 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3945283-e1ec-4f16-98eb-410d3e86d61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-869329709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f7b7822-a30e-4fe7-84b3-460fb5b9c731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eacaf6e343844cdad5ed53f7b6710f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:01:00Z,use_quota=True,user_id='0c0d12f6214c465083d314fd213c976e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:02 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129fbbaa-23d6-430a-9725-51c9ad66e53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:02 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129fbbaa-23d6-430a-9725-51c9ad66e53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:02 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96736fd5-98b0-468f-83f2-b2dc8056b6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:02 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96736fd5-98b0-468f-83f2-b2dc8056b6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f7b7822-a30e-4fe7-84b3-460fb5b9c731', 'volume_name': 'volume-3f7b7822-a30e-4fe7-84b3-460fb5b9c731', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:02 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1387cfe0-b3bf-4c1c-9fd6-365f928a61b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:02 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1387cfe0-b3bf-4c1c-9fd6-365f928a61b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:02 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0301e1d-5d2e-4638-b2cd-5956a83d63da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:02 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Volume 3f7b7822-a30e-4fe7-84b3-460fb5b9c731: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f7b7822-a30e-4fe7-84b3-460fb5b9c731', 'volume_size': 1}
Sep 10 12:01:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:01:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5385dcbb-516b-40cf-8395-cb772159542e" returned: 0 in 0.519s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:02 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] <== create_volume: return (1433ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:01:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:01:02 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Volume volume-490c7f2b-55b9-48c6-9be1-7a434079117a (490c7f2b-55b9-48c6-9be1-7a434079117a): created successfully
Sep 10 12:01:02 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ea6efd-bfb9-4070-b8a2-0ed1697f6303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:02 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Flow 'volume_create_manager' (ae6b77a5-3e80-4bb0-9eef-2abff6171679) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:01:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.596s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:01:02 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1893044845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b8eb08c-251a-4f5f-a0db-062e4af9efad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eacaf6e343844cdad5ed53f7b6710f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:01:00Z,use_quota=True,user_id='0c0d12f6214c465083d314fd213c976e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:01:02 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Creating volume 8b8eb08c-251a-4f5f-a0db-062e4af9efad {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:01:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:01:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:01:02 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:01:02 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:01:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:01:02 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:01:02 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:01:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8b8eb08c-251a-4f5f-a0db-062e4af9efad 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:02 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=121, name=volume-8b8eb08c-251a-4f5f-a0db-062e4af9efad, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:01:03 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-da76ab1a-b3a4-4540-929d-c0a4f6426910 tempest-CreateVolumesFromImageTest-372041579 None] Created volume successfully.
Sep 10 12:01:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2010e737-44a8-4b61-8e44-f4fad615f6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5385dcbb-516b-40cf-8395-cb772159542e', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccba30ee-aaaf-45c4-b84c-50f38de0ea7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8b8eb08c-251a-4f5f-a0db-062e4af9efad 1073741824" returned: 0 in 0.867s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8b8eb08c-251a-4f5f-a0db-062e4af9efad {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:03 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Volume volume-5385dcbb-516b-40cf-8395-cb772159542e (5385dcbb-516b-40cf-8395-cb772159542e): created successfully
Sep 10 12:01:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccba30ee-aaaf-45c4-b84c-50f38de0ea7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:03 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Flow 'volume_create_manager' (9a16b5f9-6212-407a-8f4c-3243e2ad84b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:01:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8b8eb08c-251a-4f5f-a0db-062e4af9efad" returned: 0 in 0.427s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] <== create_volume: return (1316ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:01:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:01:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.391s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:01:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-869329709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f7b7822-a30e-4fe7-84b3-460fb5b9c731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eacaf6e343844cdad5ed53f7b6710f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:01:00Z,use_quota=True,user_id='0c0d12f6214c465083d314fd213c976e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:01:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Creating volume 3f7b7822-a30e-4fe7-84b3-460fb5b9c731 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:01:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:01:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:01:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:01:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:01:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:01:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:01:03 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:01:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3f7b7822-a30e-4fe7-84b3-460fb5b9c731 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:03 devstack quobyte-client[82616]: System call of process 97701 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:01:03 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=122, name=volume-3f7b7822-a30e-4fe7-84b3-460fb5b9c731, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:01:04 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-54909def-36e3-4c60-9359-ba451e3029f1 tempest-CreateVolumesFromImageTest-372041579 None] Created volume successfully.
Sep 10 12:01:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e0ba27-83e1-4295-8a55-2f76da3d3151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b8eb08c-251a-4f5f-a0db-062e4af9efad', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (840f6919-0c79-4e4c-a36b-4815fb52850f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3f7b7822-a30e-4fe7-84b3-460fb5b9c731 1073741824" returned: 0 in 0.537s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3f7b7822-a30e-4fe7-84b3-460fb5b9c731 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:04 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Volume volume-8b8eb08c-251a-4f5f-a0db-062e4af9efad (8b8eb08c-251a-4f5f-a0db-062e4af9efad): created successfully
Sep 10 12:01:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (840f6919-0c79-4e4c-a36b-4815fb52850f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Flow 'volume_create_manager' (6736e6c4-e0cf-4def-82bb-3ce8b827ef7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:01:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3f7b7822-a30e-4fe7-84b3-460fb5b9c731" returned: 0 in 0.329s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:04 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] <== create_volume: return (888ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:01:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:01:04 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-2426b858-39d6-40ba-8b8c-e3778ec798b6 tempest-CreateVolumesFromImageTest-372041579 None] Created volume successfully.
Sep 10 12:01:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0301e1d-5d2e-4638-b2cd-5956a83d63da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f7b7822-a30e-4fe7-84b3-460fb5b9c731', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67b8811-6a4f-42ee-9da4-3abe370a0695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:04 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Volume volume-3f7b7822-a30e-4fe7-84b3-460fb5b9c731 (3f7b7822-a30e-4fe7-84b3-460fb5b9c731): created successfully
Sep 10 12:01:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67b8811-6a4f-42ee-9da4-3abe370a0695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Flow 'volume_create_manager' (a4b1a08e-3c22-4771-95c5-2b7e4ac73215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:01:04 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-547bf0de-be6d-4969-8606-3aa23145e230 tempest-CreateVolumesFromImageTest-372041579 None] Created volume successfully.
Sep 10 12:01:05 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ab1bb37c-4fc3-47ea-9b07-88caac20b6fa tempest-CreateVolumesFromImageTest-372041579 None] Acquiring lock "cinder-3f7b7822-a30e-4fe7-84b3-460fb5b9c731-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:01:05 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ab1bb37c-4fc3-47ea-9b07-88caac20b6fa tempest-CreateVolumesFromImageTest-372041579 None] Lock "cinder-3f7b7822-a30e-4fe7-84b3-460fb5b9c731-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:01:05 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-ab1bb37c-4fc3-47ea-9b07-88caac20b6fa tempest-CreateVolumesFromImageTest-372041579 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:01:05 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ab1bb37c-4fc3-47ea-9b07-88caac20b6fa tempest-CreateVolumesFromImageTest-372041579 None] Acquiring lock "cinder-quobyte-3f7b7822-a30e-4fe7-84b3-460fb5b9c731" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:01:05 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ab1bb37c-4fc3-47ea-9b07-88caac20b6fa tempest-CreateVolumesFromImageTest-372041579 None] Lock "cinder-quobyte-3f7b7822-a30e-4fe7-84b3-460fb5b9c731" acquired by "delete_volume" :: waited 0.027s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:01:06 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6820079-b0bd-4f21-a753-f6c68ef15165]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:01:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ab1bb37c-4fc3-47ea-9b07-88caac20b6fa tempest-CreateVolumesFromImageTest-372041579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3f7b7822-a30e-4fe7-84b3-460fb5b9c731 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ab1bb37c-4fc3-47ea-9b07-88caac20b6fa tempest-CreateVolumesFromImageTest-372041579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3f7b7822-a30e-4fe7-84b3-460fb5b9c731" returned: 0 in 0.582s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ab1bb37c-4fc3-47ea-9b07-88caac20b6fa tempest-CreateVolumesFromImageTest-372041579 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3f7b7822-a30e-4fe7-84b3-460fb5b9c731 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ab1bb37c-4fc3-47ea-9b07-88caac20b6fa tempest-CreateVolumesFromImageTest-372041579 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3f7b7822-a30e-4fe7-84b3-460fb5b9c731" returned: 0 in 0.360s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:07 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ab1bb37c-4fc3-47ea-9b07-88caac20b6fa tempest-CreateVolumesFromImageTest-372041579 None] Lock "cinder-quobyte-3f7b7822-a30e-4fe7-84b3-460fb5b9c731" released by "delete_volume" :: held 1.265s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:01:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-a659804e-c7d7-4313-a91a-bda6390f7d54 req-d1462d80-5b5c-42cc-aac3-fb29243a10c4 tempest-TestShelveInstance-527094388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:01:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-a659804e-c7d7-4313-a91a-bda6390f7d54 req-d1462d80-5b5c-42cc-aac3-fb29243a10c4 tempest-TestShelveInstance-527094388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:01:07 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-ab1bb37c-4fc3-47ea-9b07-88caac20b6fa tempest-CreateVolumesFromImageTest-372041579 None] Created reservations ['12357cbd-4798-41cc-a09e-37eef4161612', '99d8a8d2-3abe-4ba1-a632-060467d48823', 'bf6e70ab-b288-40a8-83ad-6fb51c846298', '004ab763-4540-4dce-9f45-55cddf664e82'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:01:07 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc7bc44-de8d-4316-9ff3-e4e6db42edbe]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:01:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-a659804e-c7d7-4313-a91a-bda6390f7d54 req-d1462d80-5b5c-42cc-aac3-fb29243a10c4 tempest-TestShelveInstance-527094388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-a659804e-c7d7-4313-a91a-bda6390f7d54 req-d1462d80-5b5c-42cc-aac3-fb29243a10c4 tempest-TestShelveInstance-527094388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9" returned: 0 in 0.719s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-a659804e-c7d7-4313-a91a-bda6390f7d54 req-d1462d80-5b5c-42cc-aac3-fb29243a10c4 tempest-TestShelveInstance-527094388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ab1bb37c-4fc3-47ea-9b07-88caac20b6fa tempest-CreateVolumesFromImageTest-372041579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:01:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ab1bb37c-4fc3-47ea-9b07-88caac20b6fa tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:01:08 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ab1bb37c-4fc3-47ea-9b07-88caac20b6fa tempest-CreateVolumesFromImageTest-372041579 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:01:08 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ab1bb37c-4fc3-47ea-9b07-88caac20b6fa tempest-CreateVolumesFromImageTest-372041579 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:01:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ab1bb37c-4fc3-47ea-9b07-88caac20b6fa tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:01:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ab1bb37c-4fc3-47ea-9b07-88caac20b6fa tempest-CreateVolumesFromImageTest-372041579 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ab1bb37c-4fc3-47ea-9b07-88caac20b6fa tempest-CreateVolumesFromImageTest-372041579 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.167s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:09 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-ab1bb37c-4fc3-47ea-9b07-88caac20b6fa tempest-CreateVolumesFromImageTest-372041579 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:01:09 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-ab1bb37c-4fc3-47ea-9b07-88caac20b6fa tempest-CreateVolumesFromImageTest-372041579 None] Deleted volume successfully.
Sep 10 12:01:09 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ed81cfbd-f592-46df-a0da-8e2392dc1e82 tempest-CreateVolumesFromImageTest-372041579 None] Acquiring lock "cinder-8b8eb08c-251a-4f5f-a0db-062e4af9efad-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:01:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-a659804e-c7d7-4313-a91a-bda6390f7d54 req-d1462d80-5b5c-42cc-aac3-fb29243a10c4 tempest-TestShelveInstance-527094388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9" returned: 1 in 0.967s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-a659804e-c7d7-4313-a91a-bda6390f7d54 req-d1462d80-5b5c-42cc-aac3-fb29243a10c4 tempest-TestShelveInstance-527094388 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 12:01:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-a659804e-c7d7-4313-a91a-bda6390f7d54 req-d1462d80-5b5c-42cc-aac3-fb29243a10c4 tempest-TestShelveInstance-527094388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.815s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:01:09 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ab1bb37c-4fc3-47ea-9b07-88caac20b6fa tempest-CreateVolumesFromImageTest-372041579 None] Lock "cinder-3f7b7822-a30e-4fe7-84b3-460fb5b9c731-delete_volume" released by "delete_volume" :: held 3.881s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:01:09 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ed81cfbd-f592-46df-a0da-8e2392dc1e82 tempest-CreateVolumesFromImageTest-372041579 None] Lock "cinder-8b8eb08c-251a-4f5f-a0db-062e4af9efad-delete_volume" acquired by "delete_volume" :: waited 0.165s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:01:09 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-ed81cfbd-f592-46df-a0da-8e2392dc1e82 tempest-CreateVolumesFromImageTest-372041579 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:01:09 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ed81cfbd-f592-46df-a0da-8e2392dc1e82 tempest-CreateVolumesFromImageTest-372041579 None] Acquiring lock "cinder-quobyte-8b8eb08c-251a-4f5f-a0db-062e4af9efad" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:01:09 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-a659804e-c7d7-4313-a91a-bda6390f7d54 req-d1462d80-5b5c-42cc-aac3-fb29243a10c4 tempest-TestShelveInstance-527094388 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56', 'name': 'volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bcc64ed1-4807-46b9-bf93-1902d4c50961', 'enforce_multipath': True} {{(pid=82594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 12:01:09 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-a659804e-c7d7-4313-a91a-bda6390f7d54 req-d1462d80-5b5c-42cc-aac3-fb29243a10c4 tempest-TestShelveInstance-527094388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:01:09 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ed81cfbd-f592-46df-a0da-8e2392dc1e82 tempest-CreateVolumesFromImageTest-372041579 None] Lock "cinder-quobyte-8b8eb08c-251a-4f5f-a0db-062e4af9efad" acquired by "delete_volume" :: waited 0.085s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:01:09 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[700df4e7-e21c-4507-bdd1-1d46012a80b7]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:01:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ed81cfbd-f592-46df-a0da-8e2392dc1e82 tempest-CreateVolumesFromImageTest-372041579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8b8eb08c-251a-4f5f-a0db-062e4af9efad {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:10 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-a659804e-c7d7-4313-a91a-bda6390f7d54 req-d1462d80-5b5c-42cc-aac3-fb29243a10c4 tempest-TestShelveInstance-527094388 None] attachment_update completed successfully.
Sep 10 12:01:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ed81cfbd-f592-46df-a0da-8e2392dc1e82 tempest-CreateVolumesFromImageTest-372041579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8b8eb08c-251a-4f5f-a0db-062e4af9efad" returned: 0 in 0.678s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ed81cfbd-f592-46df-a0da-8e2392dc1e82 tempest-CreateVolumesFromImageTest-372041579 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8b8eb08c-251a-4f5f-a0db-062e4af9efad {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ed81cfbd-f592-46df-a0da-8e2392dc1e82 tempest-CreateVolumesFromImageTest-372041579 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8b8eb08c-251a-4f5f-a0db-062e4af9efad" returned: 0 in 0.099s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:10 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ed81cfbd-f592-46df-a0da-8e2392dc1e82 tempest-CreateVolumesFromImageTest-372041579 None] Lock "cinder-quobyte-8b8eb08c-251a-4f5f-a0db-062e4af9efad" released by "delete_volume" :: held 0.945s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:01:11 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-ed81cfbd-f592-46df-a0da-8e2392dc1e82 tempest-CreateVolumesFromImageTest-372041579 None] Created reservations ['f2407761-9f21-4b49-a35d-bad921c9629f', 'a01df0d7-8803-4b6d-b065-f331e227ee95', '65e1df03-4264-43ba-8edd-6c3142053aab', '140ab189-aaf5-4a07-84eb-347a77d5aa8e'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:01:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ed81cfbd-f592-46df-a0da-8e2392dc1e82 tempest-CreateVolumesFromImageTest-372041579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:01:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ed81cfbd-f592-46df-a0da-8e2392dc1e82 tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:01:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ed81cfbd-f592-46df-a0da-8e2392dc1e82 tempest-CreateVolumesFromImageTest-372041579 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:01:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ed81cfbd-f592-46df-a0da-8e2392dc1e82 tempest-CreateVolumesFromImageTest-372041579 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:01:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ed81cfbd-f592-46df-a0da-8e2392dc1e82 tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:01:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ed81cfbd-f592-46df-a0da-8e2392dc1e82 tempest-CreateVolumesFromImageTest-372041579 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ed81cfbd-f592-46df-a0da-8e2392dc1e82 tempest-CreateVolumesFromImageTest-372041579 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.168s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:11 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-ed81cfbd-f592-46df-a0da-8e2392dc1e82 tempest-CreateVolumesFromImageTest-372041579 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:01:11 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-ed81cfbd-f592-46df-a0da-8e2392dc1e82 tempest-CreateVolumesFromImageTest-372041579 None] Deleted volume successfully.
Sep 10 12:01:11 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-0cba87bb-f747-4dc4-8538-7fdf2c1afb2d tempest-CreateVolumesFromImageTest-372041579 None] Acquiring lock "cinder-5385dcbb-516b-40cf-8395-cb772159542e-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:01:11 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ed81cfbd-f592-46df-a0da-8e2392dc1e82 tempest-CreateVolumesFromImageTest-372041579 None] Lock "cinder-8b8eb08c-251a-4f5f-a0db-062e4af9efad-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:01:12 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-0cba87bb-f747-4dc4-8538-7fdf2c1afb2d tempest-CreateVolumesFromImageTest-372041579 None] Lock "cinder-5385dcbb-516b-40cf-8395-cb772159542e-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:01:12 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-0cba87bb-f747-4dc4-8538-7fdf2c1afb2d tempest-CreateVolumesFromImageTest-372041579 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:01:12 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-0cba87bb-f747-4dc4-8538-7fdf2c1afb2d tempest-CreateVolumesFromImageTest-372041579 None] Acquiring lock "cinder-quobyte-5385dcbb-516b-40cf-8395-cb772159542e" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:01:12 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-0cba87bb-f747-4dc4-8538-7fdf2c1afb2d tempest-CreateVolumesFromImageTest-372041579 None] Lock "cinder-quobyte-5385dcbb-516b-40cf-8395-cb772159542e" acquired by "delete_volume" :: waited 0.012s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:01:12 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b78ac2-ad0b-44c5-b070-c8f6f1db1987]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:01:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0cba87bb-f747-4dc4-8538-7fdf2c1afb2d tempest-CreateVolumesFromImageTest-372041579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5385dcbb-516b-40cf-8395-cb772159542e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:12 devstack quobyte-client[82616]: System call of process 97730 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:01:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0cba87bb-f747-4dc4-8538-7fdf2c1afb2d tempest-CreateVolumesFromImageTest-372041579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5385dcbb-516b-40cf-8395-cb772159542e" returned: 0 in 0.498s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0cba87bb-f747-4dc4-8538-7fdf2c1afb2d tempest-CreateVolumesFromImageTest-372041579 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5385dcbb-516b-40cf-8395-cb772159542e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0cba87bb-f747-4dc4-8538-7fdf2c1afb2d tempest-CreateVolumesFromImageTest-372041579 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-5385dcbb-516b-40cf-8395-cb772159542e" returned: 0 in 0.130s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:12 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-0cba87bb-f747-4dc4-8538-7fdf2c1afb2d tempest-CreateVolumesFromImageTest-372041579 None] Lock "cinder-quobyte-5385dcbb-516b-40cf-8395-cb772159542e" released by "delete_volume" :: held 0.805s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:01:13 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-0cba87bb-f747-4dc4-8538-7fdf2c1afb2d tempest-CreateVolumesFromImageTest-372041579 None] Created reservations ['3fe080e5-eca3-4bb9-aa23-22287388fcf7', 'e7ebb8b5-76aa-4612-a764-54d85fc7fe0e', '3ac2fd0c-dfd6-449d-a467-47b3fdf7da77', '44475684-a930-44f3-9f2f-d145461a00bf'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:01:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0cba87bb-f747-4dc4-8538-7fdf2c1afb2d tempest-CreateVolumesFromImageTest-372041579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:01:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0cba87bb-f747-4dc4-8538-7fdf2c1afb2d tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:01:13 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0cba87bb-f747-4dc4-8538-7fdf2c1afb2d tempest-CreateVolumesFromImageTest-372041579 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:01:13 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0cba87bb-f747-4dc4-8538-7fdf2c1afb2d tempest-CreateVolumesFromImageTest-372041579 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:01:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0cba87bb-f747-4dc4-8538-7fdf2c1afb2d tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:01:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0cba87bb-f747-4dc4-8538-7fdf2c1afb2d tempest-CreateVolumesFromImageTest-372041579 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0cba87bb-f747-4dc4-8538-7fdf2c1afb2d tempest-CreateVolumesFromImageTest-372041579 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.124s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:13 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-0cba87bb-f747-4dc4-8538-7fdf2c1afb2d tempest-CreateVolumesFromImageTest-372041579 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:01:13 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-0cba87bb-f747-4dc4-8538-7fdf2c1afb2d tempest-CreateVolumesFromImageTest-372041579 None] Deleted volume successfully.
Sep 10 12:01:13 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-0cba87bb-f747-4dc4-8538-7fdf2c1afb2d tempest-CreateVolumesFromImageTest-372041579 None] Lock "cinder-5385dcbb-516b-40cf-8395-cb772159542e-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:01:14 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-4118ed13-4847-4020-bb61-f58f0cd25a58 tempest-CreateVolumesFromImageTest-372041579 None] Acquiring lock "cinder-490c7f2b-55b9-48c6-9be1-7a434079117a-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:01:14 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-4118ed13-4847-4020-bb61-f58f0cd25a58 tempest-CreateVolumesFromImageTest-372041579 None] Lock "cinder-490c7f2b-55b9-48c6-9be1-7a434079117a-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:01:14 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-4118ed13-4847-4020-bb61-f58f0cd25a58 tempest-CreateVolumesFromImageTest-372041579 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:01:14 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-4118ed13-4847-4020-bb61-f58f0cd25a58 tempest-CreateVolumesFromImageTest-372041579 None] Acquiring lock "cinder-quobyte-490c7f2b-55b9-48c6-9be1-7a434079117a" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:01:14 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-4118ed13-4847-4020-bb61-f58f0cd25a58 tempest-CreateVolumesFromImageTest-372041579 None] Lock "cinder-quobyte-490c7f2b-55b9-48c6-9be1-7a434079117a" acquired by "delete_volume" :: waited 0.013s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:01:14 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8506d260-9b8b-42b2-9036-61885628c26a]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:01:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4118ed13-4847-4020-bb61-f58f0cd25a58 tempest-CreateVolumesFromImageTest-372041579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-490c7f2b-55b9-48c6-9be1-7a434079117a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4118ed13-4847-4020-bb61-f58f0cd25a58 tempest-CreateVolumesFromImageTest-372041579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-490c7f2b-55b9-48c6-9be1-7a434079117a" returned: 0 in 0.522s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4118ed13-4847-4020-bb61-f58f0cd25a58 tempest-CreateVolumesFromImageTest-372041579 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-490c7f2b-55b9-48c6-9be1-7a434079117a {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4118ed13-4847-4020-bb61-f58f0cd25a58 tempest-CreateVolumesFromImageTest-372041579 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-490c7f2b-55b9-48c6-9be1-7a434079117a" returned: 0 in 0.087s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:15 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-4118ed13-4847-4020-bb61-f58f0cd25a58 tempest-CreateVolumesFromImageTest-372041579 None] Lock "cinder-quobyte-490c7f2b-55b9-48c6-9be1-7a434079117a" released by "delete_volume" :: held 0.766s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:01:15 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-4118ed13-4847-4020-bb61-f58f0cd25a58 tempest-CreateVolumesFromImageTest-372041579 None] Created reservations ['083958c6-92ef-4cc8-9b40-890d4524260e', '67e4c31d-8186-4982-a609-2aef8fd3780a', '06108822-8cef-4238-a19c-b8a1af503410', '322a2fe2-eff0-40a8-b60e-61b42ed99a00'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:01:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4118ed13-4847-4020-bb61-f58f0cd25a58 tempest-CreateVolumesFromImageTest-372041579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:01:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4118ed13-4847-4020-bb61-f58f0cd25a58 tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:01:15 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4118ed13-4847-4020-bb61-f58f0cd25a58 tempest-CreateVolumesFromImageTest-372041579 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:01:15 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4118ed13-4847-4020-bb61-f58f0cd25a58 tempest-CreateVolumesFromImageTest-372041579 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:01:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4118ed13-4847-4020-bb61-f58f0cd25a58 tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:01:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4118ed13-4847-4020-bb61-f58f0cd25a58 tempest-CreateVolumesFromImageTest-372041579 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4118ed13-4847-4020-bb61-f58f0cd25a58 tempest-CreateVolumesFromImageTest-372041579 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.103s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:15 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-4118ed13-4847-4020-bb61-f58f0cd25a58 tempest-CreateVolumesFromImageTest-372041579 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:01:15 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-4118ed13-4847-4020-bb61-f58f0cd25a58 tempest-CreateVolumesFromImageTest-372041579 None] Deleted volume successfully.
Sep 10 12:01:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-4118ed13-4847-4020-bb61-f58f0cd25a58 tempest-CreateVolumesFromImageTest-372041579 None] Lock "cinder-490c7f2b-55b9-48c6-9be1-7a434079117a-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:01:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-03ccdc35-28c4-41a7-bfab-fe0a862bfea4 tempest-CreateVolumesFromImageTest-372041579 None] Acquiring lock "cinder-a713fc36-3dad-4953-a49c-7f2e422ce3ed-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:01:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-03ccdc35-28c4-41a7-bfab-fe0a862bfea4 tempest-CreateVolumesFromImageTest-372041579 None] Lock "cinder-a713fc36-3dad-4953-a49c-7f2e422ce3ed-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:01:16 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-03ccdc35-28c4-41a7-bfab-fe0a862bfea4 tempest-CreateVolumesFromImageTest-372041579 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:01:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-03ccdc35-28c4-41a7-bfab-fe0a862bfea4 tempest-CreateVolumesFromImageTest-372041579 None] Acquiring lock "cinder-quobyte-a713fc36-3dad-4953-a49c-7f2e422ce3ed" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:01:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-03ccdc35-28c4-41a7-bfab-fe0a862bfea4 tempest-CreateVolumesFromImageTest-372041579 None] Lock "cinder-quobyte-a713fc36-3dad-4953-a49c-7f2e422ce3ed" acquired by "delete_volume" :: waited 0.010s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:01:16 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2b9487-d8b4-4fb7-a134-4bc439af88c8]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:01:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-03ccdc35-28c4-41a7-bfab-fe0a862bfea4 tempest-CreateVolumesFromImageTest-372041579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a713fc36-3dad-4953-a49c-7f2e422ce3ed {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-03ccdc35-28c4-41a7-bfab-fe0a862bfea4 tempest-CreateVolumesFromImageTest-372041579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a713fc36-3dad-4953-a49c-7f2e422ce3ed" returned: 0 in 0.642s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-03ccdc35-28c4-41a7-bfab-fe0a862bfea4 tempest-CreateVolumesFromImageTest-372041579 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a713fc36-3dad-4953-a49c-7f2e422ce3ed {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-03ccdc35-28c4-41a7-bfab-fe0a862bfea4 tempest-CreateVolumesFromImageTest-372041579 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a713fc36-3dad-4953-a49c-7f2e422ce3ed" returned: 0 in 0.158s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:17 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-03ccdc35-28c4-41a7-bfab-fe0a862bfea4 tempest-CreateVolumesFromImageTest-372041579 None] Lock "cinder-quobyte-a713fc36-3dad-4953-a49c-7f2e422ce3ed" released by "delete_volume" :: held 1.077s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:01:18 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-03ccdc35-28c4-41a7-bfab-fe0a862bfea4 tempest-CreateVolumesFromImageTest-372041579 None] Created reservations ['7fbd2a3e-b52c-4a86-bc65-89b2374a1e96', '3dab976e-3286-4cee-afd0-52eab52d46b9', '914bcec0-89cb-4881-ba3a-833613b39cd6', '39a9698c-3eed-471d-801e-53a3eafd7119'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:01:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-03ccdc35-28c4-41a7-bfab-fe0a862bfea4 tempest-CreateVolumesFromImageTest-372041579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:01:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-03ccdc35-28c4-41a7-bfab-fe0a862bfea4 tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:01:18 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-03ccdc35-28c4-41a7-bfab-fe0a862bfea4 tempest-CreateVolumesFromImageTest-372041579 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:01:18 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-03ccdc35-28c4-41a7-bfab-fe0a862bfea4 tempest-CreateVolumesFromImageTest-372041579 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:01:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-03ccdc35-28c4-41a7-bfab-fe0a862bfea4 tempest-CreateVolumesFromImageTest-372041579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:01:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-03ccdc35-28c4-41a7-bfab-fe0a862bfea4 tempest-CreateVolumesFromImageTest-372041579 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-03ccdc35-28c4-41a7-bfab-fe0a862bfea4 tempest-CreateVolumesFromImageTest-372041579 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.203s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:18 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-03ccdc35-28c4-41a7-bfab-fe0a862bfea4 tempest-CreateVolumesFromImageTest-372041579 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:01:18 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-03ccdc35-28c4-41a7-bfab-fe0a862bfea4 tempest-CreateVolumesFromImageTest-372041579 None] Deleted volume successfully.
Sep 10 12:01:19 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-03ccdc35-28c4-41a7-bfab-fe0a862bfea4 tempest-CreateVolumesFromImageTest-372041579 None] Lock "cinder-a713fc36-3dad-4953-a49c-7f2e422ce3ed-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:01:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 12:01:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:01:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:01:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:01:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:01:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.083s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:01:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.387s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:23 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:01:26 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:01:26 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:01:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Flow 'volume_create_manager' (a9d25204-de56-4a14-baba-8ae7c79457df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:01:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2f8cff-1fbf-43d9-a9ff-1042a33f4c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2f8cff-1fbf-43d9-a9ff-1042a33f4c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2e1e6e3-64e5-4fdb-a455-cdc6e2dbbf71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093d690c7ef14a94bea9e1c72274850f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:01:26Z,use_quota=True,user_id='d8e42e90e4d94cd8b1769064c673f29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88386562-47c9-409f-9fb5-8abe42154b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88386562-47c9-409f-9fb5-8abe42154b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c646c8d6-a34a-460d-b155-a8859ee10ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c646c8d6-a34a-460d-b155-a8859ee10ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2e1e6e3-64e5-4fdb-a455-cdc6e2dbbf71', 'volume_name': 'volume-d2e1e6e3-64e5-4fdb-a455-cdc6e2dbbf71', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43390b47-8d4e-4249-8b55-98f2eeec2d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43390b47-8d4e-4249-8b55-98f2eeec2d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f818e9e-3cf6-4f7a-960d-daf8b9d5da9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:26 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Volume d2e1e6e3-64e5-4fdb-a455-cdc6e2dbbf71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2e1e6e3-64e5-4fdb-a455-cdc6e2dbbf71', 'volume_size': 1}
Sep 10 12:01:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:01:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:01:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2e1e6e3-64e5-4fdb-a455-cdc6e2dbbf71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093d690c7ef14a94bea9e1c72274850f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:01:26Z,use_quota=True,user_id='d8e42e90e4d94cd8b1769064c673f29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:01:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Creating volume d2e1e6e3-64e5-4fdb-a455-cdc6e2dbbf71 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:01:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:01:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:01:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:01:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:01:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:01:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:01:26 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:01:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-d2e1e6e3-64e5-4fdb-a455-cdc6e2dbbf71 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:26 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=123, name=volume-d2e1e6e3-64e5-4fdb-a455-cdc6e2dbbf71, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:01:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-d2e1e6e3-64e5-4fdb-a455-cdc6e2dbbf71 1073741824" returned: 0 in 0.490s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-d2e1e6e3-64e5-4fdb-a455-cdc6e2dbbf71 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-d2e1e6e3-64e5-4fdb-a455-cdc6e2dbbf71" returned: 0 in 0.323s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] <== create_volume: return (987ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:01:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:01:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f818e9e-3cf6-4f7a-960d-daf8b9d5da9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2e1e6e3-64e5-4fdb-a455-cdc6e2dbbf71', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4efb50-056f-4cef-86e6-8405a019715a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:27 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Volume volume-d2e1e6e3-64e5-4fdb-a455-cdc6e2dbbf71 (d2e1e6e3-64e5-4fdb-a455-cdc6e2dbbf71): created successfully
Sep 10 12:01:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4efb50-056f-4cef-86e6-8405a019715a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Flow 'volume_create_manager' (a9d25204-de56-4a14-baba-8ae7c79457df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:01:27 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-d9be33c4-d1fb-415a-8d07-c1a18d22753f tempest-CinderUnicodeTest-1399965705 None] Created volume successfully.
Sep 10 12:01:29 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:01:29 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:01:29 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Flow 'volume_create_manager' (70220e4f-3ba7-4ca1-ac6f-daf4bd3cc000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:01:29 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99811efa-baa4-4d6a-8863-71660071d118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:29 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99811efa-baa4-4d6a-8863-71660071d118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:01:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-894524830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b580fb1c-483e-431d-9323-5c9ca556361e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093d690c7ef14a94bea9e1c72274850f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:01:29Z,use_quota=True,user_id='d8e42e90e4d94cd8b1769064c673f29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:29 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed283e5-ccd7-4c25-bd78-6a23eec0992a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:29 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed283e5-ccd7-4c25-bd78-6a23eec0992a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:29 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13388ad-617c-4cfc-a2d5-6d545adf5255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:29 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13388ad-617c-4cfc-a2d5-6d545adf5255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b580fb1c-483e-431d-9323-5c9ca556361e', 'volume_name': 'volume-b580fb1c-483e-431d-9323-5c9ca556361e', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:29 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99451cca-a131-4fb3-9009-44f462ce0e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:29 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99451cca-a131-4fb3-9009-44f462ce0e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:29 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06663399-9556-4c76-b87e-714a582d3abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:29 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Volume b580fb1c-483e-431d-9323-5c9ca556361e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b580fb1c-483e-431d-9323-5c9ca556361e', 'volume_size': 1}
Sep 10 12:01:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:01:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:01:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:01:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-894524830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b580fb1c-483e-431d-9323-5c9ca556361e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093d690c7ef14a94bea9e1c72274850f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:01:29Z,use_quota=True,user_id='d8e42e90e4d94cd8b1769064c673f29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:01:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Creating volume b580fb1c-483e-431d-9323-5c9ca556361e {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:01:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:01:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:01:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:01:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:01:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:01:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:01:29 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:01:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:30 devstack quobyte-client[82616]: System call of process 98212 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:01:30 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=124, name=volume-b580fb1c-483e-431d-9323-5c9ca556361e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:01:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e 1073741824" returned: 0 in 0.711s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e" returned: 0 in 0.152s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:30 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] <== create_volume: return (947ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:01:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:01:31 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06663399-9556-4c76-b87e-714a582d3abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b580fb1c-483e-431d-9323-5c9ca556361e', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:31 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528fe0e0-102b-4bcf-8c72-193f456e8270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:01:31 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Volume volume-b580fb1c-483e-431d-9323-5c9ca556361e (b580fb1c-483e-431d-9323-5c9ca556361e): created successfully
Sep 10 12:01:31 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528fe0e0-102b-4bcf-8c72-193f456e8270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:01:31 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Flow 'volume_create_manager' (70220e4f-3ba7-4ca1-ac6f-daf4bd3cc000) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:01:31 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-72422d6d-ef04-4fdd-97fe-51eb523a2c0d tempest-CinderUnicodeTest-1399965705 None] Created volume successfully.
Sep 10 12:01:32 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-cb03615b-ac5c-444f-ba29-7d03904afd4a tempest-CinderUnicodeTest-1399965705 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:01:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cb03615b-ac5c-444f-ba29-7d03904afd4a tempest-CinderUnicodeTest-1399965705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:01:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cb03615b-ac5c-444f-ba29-7d03904afd4a tempest-CinderUnicodeTest-1399965705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:01:32 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-cb03615b-ac5c-444f-ba29-7d03904afd4a tempest-CinderUnicodeTest-1399965705 None] Creating offline snapshot 1e6f9cc9-4134-47d2-992c-eb589f389a12 of volume b580fb1c-483e-431d-9323-5c9ca556361e {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 12:01:32 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e707ac-f4a3-4516-8642-54ffa9a8fcae]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:01:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cb03615b-ac5c-444f-ba29-7d03904afd4a tempest-CinderUnicodeTest-1399965705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:33 devstack quobyte-client[82616]: System call of process 98223 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:01:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cb03615b-ac5c-444f-ba29-7d03904afd4a tempest-CinderUnicodeTest-1399965705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e" returned: 0 in 1.127s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cb03615b-ac5c-444f-ba29-7d03904afd4a tempest-CinderUnicodeTest-1399965705 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e.1e6f9cc9-4134-47d2-992c-eb589f389a12 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:34 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=125, name=volume-b580fb1c-483e-431d-9323-5c9ca556361e.1e6f9cc9-4134-47d2-992c-eb589f389a12, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:01:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cb03615b-ac5c-444f-ba29-7d03904afd4a tempest-CinderUnicodeTest-1399965705 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e.1e6f9cc9-4134-47d2-992c-eb589f389a12 1G" returned: 0 in 0.533s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cb03615b-ac5c-444f-ba29-7d03904afd4a tempest-CinderUnicodeTest-1399965705 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b580fb1c-483e-431d-9323-5c9ca556361e -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e.1e6f9cc9-4134-47d2-992c-eb589f389a12 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:34 devstack quobyte-client[82616]: System call of process 98254 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:01:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cb03615b-ac5c-444f-ba29-7d03904afd4a tempest-CinderUnicodeTest-1399965705 None] CMD "qemu-img rebase -u -b volume-b580fb1c-483e-431d-9323-5c9ca556361e -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e.1e6f9cc9-4134-47d2-992c-eb589f389a12" returned: 0 in 0.374s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:34 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-cb03615b-ac5c-444f-ba29-7d03904afd4a tempest-CinderUnicodeTest-1399965705 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e.1e6f9cc9-4134-47d2-992c-eb589f389a12 is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 12:01:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cb03615b-ac5c-444f-ba29-7d03904afd4a tempest-CinderUnicodeTest-1399965705 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e.1e6f9cc9-4134-47d2-992c-eb589f389a12 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cb03615b-ac5c-444f-ba29-7d03904afd4a tempest-CinderUnicodeTest-1399965705 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e.1e6f9cc9-4134-47d2-992c-eb589f389a12" returned: 0 in 0.252s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:35 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-cb03615b-ac5c-444f-ba29-7d03904afd4a tempest-CinderUnicodeTest-1399965705 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 12:01:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cb03615b-ac5c-444f-ba29-7d03904afd4a tempest-CinderUnicodeTest-1399965705 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e.1e6f9cc9-4134-47d2-992c-eb589f389a12 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cb03615b-ac5c-444f-ba29-7d03904afd4a tempest-CinderUnicodeTest-1399965705 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e.1e6f9cc9-4134-47d2-992c-eb589f389a12" returned: 0 in 0.225s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cb03615b-ac5c-444f-ba29-7d03904afd4a tempest-CinderUnicodeTest-1399965705 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cb03615b-ac5c-444f-ba29-7d03904afd4a tempest-CinderUnicodeTest-1399965705 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e.info" returned: 0 in 0.211s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:35 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-cb03615b-ac5c-444f-ba29-7d03904afd4a tempest-CinderUnicodeTest-1399965705 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e.info is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 12:01:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cb03615b-ac5c-444f-ba29-7d03904afd4a tempest-CinderUnicodeTest-1399965705 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-cb03615b-ac5c-444f-ba29-7d03904afd4a tempest-CinderUnicodeTest-1399965705 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e.info" returned: 0 in 0.231s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-cb03615b-ac5c-444f-ba29-7d03904afd4a tempest-CinderUnicodeTest-1399965705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.510s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:01:36 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-cb03615b-ac5c-444f-ba29-7d03904afd4a tempest-CinderUnicodeTest-1399965705 None] Create snapshot completed successfully
Sep 10 12:01:37 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-eba43ec9-feb6-4bf8-a5d6-75d893186037 tempest-CinderUnicodeTest-1399965705 None] Acquiring lock "cinder-1e6f9cc9-4134-47d2-992c-eb589f389a12-delete_snapshot" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:01:37 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-eba43ec9-feb6-4bf8-a5d6-75d893186037 tempest-CinderUnicodeTest-1399965705 None] Lock "cinder-1e6f9cc9-4134-47d2-992c-eb589f389a12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.116s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:01:37 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-eba43ec9-feb6-4bf8-a5d6-75d893186037 tempest-CinderUnicodeTest-1399965705 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:01:37 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-eba43ec9-feb6-4bf8-a5d6-75d893186037 tempest-CinderUnicodeTest-1399965705 None] Acquiring lock "cinder-quobyte-b580fb1c-483e-431d-9323-5c9ca556361e" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:01:37 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-eba43ec9-feb6-4bf8-a5d6-75d893186037 tempest-CinderUnicodeTest-1399965705 None] Lock "cinder-quobyte-b580fb1c-483e-431d-9323-5c9ca556361e" acquired by "delete_snapshot" :: waited 0.037s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:01:37 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-eba43ec9-feb6-4bf8-a5d6-75d893186037 tempest-CinderUnicodeTest-1399965705 None] Acquiring lock "cinder-quobyte-1e6f9cc9-4134-47d2-992c-eb589f389a12" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:01:37 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-eba43ec9-feb6-4bf8-a5d6-75d893186037 tempest-CinderUnicodeTest-1399965705 None] Lock "cinder-quobyte-1e6f9cc9-4134-47d2-992c-eb589f389a12" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:01:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-eba43ec9-feb6-4bf8-a5d6-75d893186037 tempest-CinderUnicodeTest-1399965705 None] Deleting offline snapshot 1e6f9cc9-4134-47d2-992c-eb589f389a12 of volume b580fb1c-483e-431d-9323-5c9ca556361e {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 12:01:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-eba43ec9-feb6-4bf8-a5d6-75d893186037 tempest-CinderUnicodeTest-1399965705 None] snapshot_file for this snap is: volume-b580fb1c-483e-431d-9323-5c9ca556361e.1e6f9cc9-4134-47d2-992c-eb589f389a12 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 12:01:37 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2461e9-acd7-46db-97a4-93b4f68767c9]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:01:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-eba43ec9-feb6-4bf8-a5d6-75d893186037 tempest-CinderUnicodeTest-1399965705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e.1e6f9cc9-4134-47d2-992c-eb589f389a12 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-eba43ec9-feb6-4bf8-a5d6-75d893186037 tempest-CinderUnicodeTest-1399965705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e.1e6f9cc9-4134-47d2-992c-eb589f389a12" returned: 0 in 0.490s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-eba43ec9-feb6-4bf8-a5d6-75d893186037 tempest-CinderUnicodeTest-1399965705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b580fb1c-483e-431d-9323-5c9ca556361e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 12:01:37 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87227c7-3d4a-44ca-9c18-39f43c50d5cf]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:01:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-eba43ec9-feb6-4bf8-a5d6-75d893186037 tempest-CinderUnicodeTest-1399965705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-eba43ec9-feb6-4bf8-a5d6-75d893186037 tempest-CinderUnicodeTest-1399965705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e" returned: 0 in 0.425s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-eba43ec9-feb6-4bf8-a5d6-75d893186037 tempest-CinderUnicodeTest-1399965705 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e.1e6f9cc9-4134-47d2-992c-eb589f389a12 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-eba43ec9-feb6-4bf8-a5d6-75d893186037 tempest-CinderUnicodeTest-1399965705 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e.1e6f9cc9-4134-47d2-992c-eb589f389a12" returned: 0 in 0.265s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-eba43ec9-feb6-4bf8-a5d6-75d893186037 tempest-CinderUnicodeTest-1399965705 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e.1e6f9cc9-4134-47d2-992c-eb589f389a12 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-eba43ec9-feb6-4bf8-a5d6-75d893186037 tempest-CinderUnicodeTest-1399965705 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e.1e6f9cc9-4134-47d2-992c-eb589f389a12" returned: 0 in 0.094s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:38 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-eba43ec9-feb6-4bf8-a5d6-75d893186037 tempest-CinderUnicodeTest-1399965705 None] Lock "cinder-quobyte-1e6f9cc9-4134-47d2-992c-eb589f389a12" released by "_delete_snapshot" :: held 1.646s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:01:38 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-eba43ec9-feb6-4bf8-a5d6-75d893186037 tempest-CinderUnicodeTest-1399965705 None] Lock "cinder-quobyte-b580fb1c-483e-431d-9323-5c9ca556361e" released by "delete_snapshot" :: held 1.685s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:01:39 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-eba43ec9-feb6-4bf8-a5d6-75d893186037 tempest-CinderUnicodeTest-1399965705 None] Created reservations ['3144777e-e908-471d-b0a7-c2b79037fa3b', 'c777876d-3a9a-485b-91dc-bb001f4acb7d', '9a199a2c-a2f2-49a3-a52b-00f9fece2c7f', 'ce5243c2-a62b-4dcf-aec4-c79c43d5dc16'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:01:39 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-eba43ec9-feb6-4bf8-a5d6-75d893186037 tempest-CinderUnicodeTest-1399965705 None] Delete snapshot completed successfully.
Sep 10 12:01:39 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-eba43ec9-feb6-4bf8-a5d6-75d893186037 tempest-CinderUnicodeTest-1399965705 None] Lock "cinder-1e6f9cc9-4134-47d2-992c-eb589f389a12-delete_snapshot" released by "delete_snapshot" :: held 2.233s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:01:40 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-62ab77b9-5ba8-481c-992c-aa14c96a3827 tempest-CinderUnicodeTest-1399965705 None] Acquiring lock "cinder-b580fb1c-483e-431d-9323-5c9ca556361e-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:01:40 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-62ab77b9-5ba8-481c-992c-aa14c96a3827 tempest-CinderUnicodeTest-1399965705 None] Lock "cinder-b580fb1c-483e-431d-9323-5c9ca556361e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:01:40 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=63,cinder:SELECT=54,cinder:INSERT=18,cinder:DELETE=7 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 12:01:40 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=51,cinder:UPDATE=69,cinder:INSERT=19,cinder:DELETE=7 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 12:01:40 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-62ab77b9-5ba8-481c-992c-aa14c96a3827 tempest-CinderUnicodeTest-1399965705 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:01:40 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-62ab77b9-5ba8-481c-992c-aa14c96a3827 tempest-CinderUnicodeTest-1399965705 None] Acquiring lock "cinder-quobyte-b580fb1c-483e-431d-9323-5c9ca556361e" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:01:40 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-62ab77b9-5ba8-481c-992c-aa14c96a3827 tempest-CinderUnicodeTest-1399965705 None] Lock "cinder-quobyte-b580fb1c-483e-431d-9323-5c9ca556361e" acquired by "delete_volume" :: waited 0.017s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:01:40 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a445bab9-f713-4d7c-a5ed-69bc5e6ccc23]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:01:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-62ab77b9-5ba8-481c-992c-aa14c96a3827 tempest-CinderUnicodeTest-1399965705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-62ab77b9-5ba8-481c-992c-aa14c96a3827 tempest-CinderUnicodeTest-1399965705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e" returned: 0 in 0.470s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-62ab77b9-5ba8-481c-992c-aa14c96a3827 tempest-CinderUnicodeTest-1399965705 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-62ab77b9-5ba8-481c-992c-aa14c96a3827 tempest-CinderUnicodeTest-1399965705 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-b580fb1c-483e-431d-9323-5c9ca556361e" returned: 0 in 0.105s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:41 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-62ab77b9-5ba8-481c-992c-aa14c96a3827 tempest-CinderUnicodeTest-1399965705 None] Lock "cinder-quobyte-b580fb1c-483e-431d-9323-5c9ca556361e" released by "delete_volume" :: held 0.733s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:01:41 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-62ab77b9-5ba8-481c-992c-aa14c96a3827 tempest-CinderUnicodeTest-1399965705 None] Created reservations ['f5ccb697-faaa-4224-b1a0-a23fe11841db', '3859cfce-7924-49d1-aec2-f577edb44992', 'a8886760-39b1-4918-8724-94e99ed487c4', 'f2974227-7523-472d-b692-7390b52a7b44'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:01:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-62ab77b9-5ba8-481c-992c-aa14c96a3827 tempest-CinderUnicodeTest-1399965705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:01:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-62ab77b9-5ba8-481c-992c-aa14c96a3827 tempest-CinderUnicodeTest-1399965705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:01:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-62ab77b9-5ba8-481c-992c-aa14c96a3827 tempest-CinderUnicodeTest-1399965705 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:01:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-62ab77b9-5ba8-481c-992c-aa14c96a3827 tempest-CinderUnicodeTest-1399965705 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:01:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-62ab77b9-5ba8-481c-992c-aa14c96a3827 tempest-CinderUnicodeTest-1399965705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:01:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-62ab77b9-5ba8-481c-992c-aa14c96a3827 tempest-CinderUnicodeTest-1399965705 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-62ab77b9-5ba8-481c-992c-aa14c96a3827 tempest-CinderUnicodeTest-1399965705 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.095s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:42 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-62ab77b9-5ba8-481c-992c-aa14c96a3827 tempest-CinderUnicodeTest-1399965705 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:01:42 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-62ab77b9-5ba8-481c-992c-aa14c96a3827 tempest-CinderUnicodeTest-1399965705 None] Deleted volume successfully.
Sep 10 12:01:42 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-62ab77b9-5ba8-481c-992c-aa14c96a3827 tempest-CinderUnicodeTest-1399965705 None] Lock "cinder-b580fb1c-483e-431d-9323-5c9ca556361e-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:01:43 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a0de8c20-e708-4f3e-898b-94b73adc636f tempest-CinderUnicodeTest-1399965705 None] Acquiring lock "cinder-d2e1e6e3-64e5-4fdb-a455-cdc6e2dbbf71-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:01:43 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a0de8c20-e708-4f3e-898b-94b73adc636f tempest-CinderUnicodeTest-1399965705 None] Lock "cinder-d2e1e6e3-64e5-4fdb-a455-cdc6e2dbbf71-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:01:43 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-a0de8c20-e708-4f3e-898b-94b73adc636f tempest-CinderUnicodeTest-1399965705 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:01:43 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a0de8c20-e708-4f3e-898b-94b73adc636f tempest-CinderUnicodeTest-1399965705 None] Acquiring lock "cinder-quobyte-d2e1e6e3-64e5-4fdb-a455-cdc6e2dbbf71" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:01:43 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a0de8c20-e708-4f3e-898b-94b73adc636f tempest-CinderUnicodeTest-1399965705 None] Lock "cinder-quobyte-d2e1e6e3-64e5-4fdb-a455-cdc6e2dbbf71" acquired by "delete_volume" :: waited 0.021s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:01:43 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[458f2f8f-2238-48ba-99e2-8e706423a933]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:01:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a0de8c20-e708-4f3e-898b-94b73adc636f tempest-CinderUnicodeTest-1399965705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-d2e1e6e3-64e5-4fdb-a455-cdc6e2dbbf71 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a0de8c20-e708-4f3e-898b-94b73adc636f tempest-CinderUnicodeTest-1399965705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-d2e1e6e3-64e5-4fdb-a455-cdc6e2dbbf71" returned: 0 in 0.496s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a0de8c20-e708-4f3e-898b-94b73adc636f tempest-CinderUnicodeTest-1399965705 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-d2e1e6e3-64e5-4fdb-a455-cdc6e2dbbf71 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a0de8c20-e708-4f3e-898b-94b73adc636f tempest-CinderUnicodeTest-1399965705 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-d2e1e6e3-64e5-4fdb-a455-cdc6e2dbbf71" returned: 0 in 0.109s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:44 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a0de8c20-e708-4f3e-898b-94b73adc636f tempest-CinderUnicodeTest-1399965705 None] Lock "cinder-quobyte-d2e1e6e3-64e5-4fdb-a455-cdc6e2dbbf71" released by "delete_volume" :: held 0.819s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:01:44 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-a0de8c20-e708-4f3e-898b-94b73adc636f tempest-CinderUnicodeTest-1399965705 None] Created reservations ['35e52848-7b27-41ea-93e7-92073a6b2602', 'd65d708d-0365-4548-83f7-3e6dccdd9b80', '9e590639-4ed2-47eb-b42b-e02419e2c504', '6136862d-f22a-43f6-8341-b57162ea7c0f'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:01:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a0de8c20-e708-4f3e-898b-94b73adc636f tempest-CinderUnicodeTest-1399965705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:01:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a0de8c20-e708-4f3e-898b-94b73adc636f tempest-CinderUnicodeTest-1399965705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:01:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-a0de8c20-e708-4f3e-898b-94b73adc636f tempest-CinderUnicodeTest-1399965705 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:01:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-a0de8c20-e708-4f3e-898b-94b73adc636f tempest-CinderUnicodeTest-1399965705 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:01:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a0de8c20-e708-4f3e-898b-94b73adc636f tempest-CinderUnicodeTest-1399965705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:01:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a0de8c20-e708-4f3e-898b-94b73adc636f tempest-CinderUnicodeTest-1399965705 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:01:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a0de8c20-e708-4f3e-898b-94b73adc636f tempest-CinderUnicodeTest-1399965705 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.125s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:01:44 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-a0de8c20-e708-4f3e-898b-94b73adc636f tempest-CinderUnicodeTest-1399965705 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:01:44 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-a0de8c20-e708-4f3e-898b-94b73adc636f tempest-CinderUnicodeTest-1399965705 None] Deleted volume successfully.
Sep 10 12:01:45 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a0de8c20-e708-4f3e-898b-94b73adc636f tempest-CinderUnicodeTest-1399965705 None] Lock "cinder-d2e1e6e3-64e5-4fdb-a455-cdc6e2dbbf71-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:01:54 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=6,cinder:INSERT=4,cinder:UPDATE=19,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 12:01:55 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=13,cinder:INSERT=4,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 12:02:16 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 12:02:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 12:02:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:02:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:02:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:02:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:02:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:02:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:02:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.219s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:02:23 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:02:47 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-231fc888-c5ba-4a6b-9cd0-e96a4d637c77 req-24f2f80d-145c-4385-b555-98faa9a8a59e tempest-TestShelveInstance-527094388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:02:47 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-231fc888-c5ba-4a6b-9cd0-e96a4d637c77 req-24f2f80d-145c-4385-b555-98faa9a8a59e tempest-TestShelveInstance-527094388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:02:47 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-231fc888-c5ba-4a6b-9cd0-e96a4d637c77 req-24f2f80d-145c-4385-b555-98faa9a8a59e tempest-TestShelveInstance-527094388 None] Terminate volume connection completed successfully.
Sep 10 12:02:47 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-231fc888-c5ba-4a6b-9cd0-e96a4d637c77 req-24f2f80d-145c-4385-b555-98faa9a8a59e tempest-TestShelveInstance-527094388 None] Deleting attachment bcc64ed1-4807-46b9-bf93-1902d4c50961. {{(pid=82594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 12:02:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-2cd02d4d-da22-4ec1-9a9f-c3445fb15176 req-c43e9088-5d9a-41b2-ae22-cb65f5a7e13c tempest-TestShelveInstance-527094388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:02:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-2cd02d4d-da22-4ec1-9a9f-c3445fb15176 req-c43e9088-5d9a-41b2-ae22-cb65f5a7e13c tempest-TestShelveInstance-527094388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:02:53 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44fcb2a-5beb-479c-b994-d9fbf9518afd]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:02:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-2cd02d4d-da22-4ec1-9a9f-c3445fb15176 req-c43e9088-5d9a-41b2-ae22-cb65f5a7e13c tempest-TestShelveInstance-527094388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:02:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-2cd02d4d-da22-4ec1-9a9f-c3445fb15176 req-c43e9088-5d9a-41b2-ae22-cb65f5a7e13c tempest-TestShelveInstance-527094388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9" returned: 0 in 0.382s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:02:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-2cd02d4d-da22-4ec1-9a9f-c3445fb15176 req-c43e9088-5d9a-41b2-ae22-cb65f5a7e13c tempest-TestShelveInstance-527094388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:02:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-2cd02d4d-da22-4ec1-9a9f-c3445fb15176 req-c43e9088-5d9a-41b2-ae22-cb65f5a7e13c tempest-TestShelveInstance-527094388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9" returned: 1 in 0.411s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:02:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-2cd02d4d-da22-4ec1-9a9f-c3445fb15176 req-c43e9088-5d9a-41b2-ae22-cb65f5a7e13c tempest-TestShelveInstance-527094388 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 12:02:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-2cd02d4d-da22-4ec1-9a9f-c3445fb15176 req-c43e9088-5d9a-41b2-ae22-cb65f5a7e13c tempest-TestShelveInstance-527094388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.971s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:02:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-2cd02d4d-da22-4ec1-9a9f-c3445fb15176 req-c43e9088-5d9a-41b2-ae22-cb65f5a7e13c tempest-TestShelveInstance-527094388 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56', 'name': 'volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e70df250-aa51-4f31-bafa-c0cc8bf427ef', 'enforce_multipath': True} {{(pid=82594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 12:02:54 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-2cd02d4d-da22-4ec1-9a9f-c3445fb15176 req-c43e9088-5d9a-41b2-ae22-cb65f5a7e13c tempest-TestShelveInstance-527094388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:02:55 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-2cd02d4d-da22-4ec1-9a9f-c3445fb15176 req-c43e9088-5d9a-41b2-ae22-cb65f5a7e13c tempest-TestShelveInstance-527094388 None] attachment_update completed successfully.
Sep 10 12:03:05 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 12:03:05 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 12:03:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 12:03:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:03:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:03:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:03:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:03:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:03:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:03:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.102s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:03:22 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:04:16 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 12:04:16 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 12:04:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 12:04:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:04:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:04:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:04:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:04:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:04:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:04:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.285s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:04:23 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:04:27 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-a9a9f06a-2a40-4f64-9466-4b09d149e056 tempest-TestShelveInstance-527094388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:04:28 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-a9a9f06a-2a40-4f64-9466-4b09d149e056 tempest-TestShelveInstance-527094388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:04:28 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-a9a9f06a-2a40-4f64-9466-4b09d149e056 tempest-TestShelveInstance-527094388 None] Terminate volume connection completed successfully.
Sep 10 12:04:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-a9a9f06a-2a40-4f64-9466-4b09d149e056 tempest-TestShelveInstance-527094388 None] Deleting attachment e70df250-aa51-4f31-bafa-c0cc8bf427ef. {{(pid=82594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 12:04:28 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-c0216ad9-830d-42e6-847a-10c502fa4e5e tempest-TestShelveInstance-527094388 None] Acquiring lock "cinder-db0fc41f-cc75-46c3-ae10-60b05607d7b9-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:04:28 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-c0216ad9-830d-42e6-847a-10c502fa4e5e tempest-TestShelveInstance-527094388 None] Lock "cinder-db0fc41f-cc75-46c3-ae10-60b05607d7b9-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:04:28 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-c0216ad9-830d-42e6-847a-10c502fa4e5e tempest-TestShelveInstance-527094388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:04:28 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-c0216ad9-830d-42e6-847a-10c502fa4e5e tempest-TestShelveInstance-527094388 None] Acquiring lock "cinder-quobyte-db0fc41f-cc75-46c3-ae10-60b05607d7b9" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:04:28 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-c0216ad9-830d-42e6-847a-10c502fa4e5e tempest-TestShelveInstance-527094388 None] Lock "cinder-quobyte-db0fc41f-cc75-46c3-ae10-60b05607d7b9" acquired by "delete_volume" :: waited 0.021s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:04:29 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[433ffd10-aa68-470a-b5a5-8d4ae933cde7]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:04:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-c0216ad9-830d-42e6-847a-10c502fa4e5e tempest-TestShelveInstance-527094388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:04:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-c0216ad9-830d-42e6-847a-10c502fa4e5e tempest-TestShelveInstance-527094388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9" returned: 0 in 0.399s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:04:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-c0216ad9-830d-42e6-847a-10c502fa4e5e tempest-TestShelveInstance-527094388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:04:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-c0216ad9-830d-42e6-847a-10c502fa4e5e tempest-TestShelveInstance-527094388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9" returned: 1 in 0.483s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:04:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-c0216ad9-830d-42e6-847a-10c502fa4e5e tempest-TestShelveInstance-527094388 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 12:04:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-c0216ad9-830d-42e6-847a-10c502fa4e5e tempest-TestShelveInstance-527094388 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:04:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-c0216ad9-830d-42e6-847a-10c502fa4e5e tempest-TestShelveInstance-527094388 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-db0fc41f-cc75-46c3-ae10-60b05607d7b9" returned: 0 in 0.114s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:04:30 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-c0216ad9-830d-42e6-847a-10c502fa4e5e tempest-TestShelveInstance-527094388 None] Lock "cinder-quobyte-db0fc41f-cc75-46c3-ae10-60b05607d7b9" released by "delete_volume" :: held 1.302s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:04:30 devstack cinder-volume[82594]: DEBUG cinder.quota [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-c0216ad9-830d-42e6-847a-10c502fa4e5e tempest-TestShelveInstance-527094388 None] Created reservations ['458db00f-f7ea-4206-8c2f-94c8d26a9ded', 'ddd12556-b620-4ee8-9978-58f37e2f6ff0', '871ca1db-a378-43cd-baa5-66cf03169d06', '2ac2a4e2-1d8e-4617-a3cc-63c66b77eac6'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:04:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-c0216ad9-830d-42e6-847a-10c502fa4e5e tempest-TestShelveInstance-527094388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:04:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-c0216ad9-830d-42e6-847a-10c502fa4e5e tempest-TestShelveInstance-527094388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:04:30 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-c0216ad9-830d-42e6-847a-10c502fa4e5e tempest-TestShelveInstance-527094388 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:04:30 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-c0216ad9-830d-42e6-847a-10c502fa4e5e tempest-TestShelveInstance-527094388 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:04:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-c0216ad9-830d-42e6-847a-10c502fa4e5e tempest-TestShelveInstance-527094388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:04:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-c0216ad9-830d-42e6-847a-10c502fa4e5e tempest-TestShelveInstance-527094388 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:04:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-c0216ad9-830d-42e6-847a-10c502fa4e5e tempest-TestShelveInstance-527094388 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.084s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:04:30 devstack cinder-volume[82594]: DEBUG cinder.manager [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-c0216ad9-830d-42e6-847a-10c502fa4e5e tempest-TestShelveInstance-527094388 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:04:30 devstack cinder-volume[82594]: INFO cinder.volume.manager [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-c0216ad9-830d-42e6-847a-10c502fa4e5e tempest-TestShelveInstance-527094388 None] Deleted volume successfully.
Sep 10 12:04:31 devstack cinder-volume[82594]: DEBUG cinder.coordination [req-0ba4e995-998a-4729-ad71-79fc52bfb3e9 req-c0216ad9-830d-42e6-847a-10c502fa4e5e tempest-TestShelveInstance-527094388 None] Lock "cinder-db0fc41f-cc75-46c3-ae10-60b05607d7b9-delete_volume" released by "delete_volume" :: held 2.389s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:04:40 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=8,cinder:INSERT=3,cinder:UPDATE=9 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 12:04:41 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=7,cinder:SELECT=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 12:04:49 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:04:49 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Flow 'volume_create_manager' (5c9fd624-55ed-4c01-b4f7-3fe81cc531f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a29490-2eb7-4d73-ad43-64569ba4a014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a29490-2eb7-4d73-ad43-64569ba4a014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-796473002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a61f2da5-aada-408a-b776-981e5a67cd4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01226b32dcf42749602d000440ad75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:04:50Z,use_quota=True,user_id='59042443602e449d8f1ee923f8210314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f14105a2-c3b0-43d8-9c05-9406a071949e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f14105a2-c3b0-43d8-9c05-9406a071949e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189ad63d-d646-4ecd-a2d5-1fc2cc879524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189ad63d-d646-4ecd-a2d5-1fc2cc879524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a61f2da5-aada-408a-b776-981e5a67cd4c', 'volume_name': 'volume-a61f2da5-aada-408a-b776-981e5a67cd4c', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1dd0b9-1c00-48b0-9c6f-4ef4c30d52ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1dd0b9-1c00-48b0-9c6f-4ef4c30d52ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50196323-b1e2-47ee-953b-46a86b090f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:50 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume a61f2da5-aada-408a-b776-981e5a67cd4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a61f2da5-aada-408a-b776-981e5a67cd4c', 'volume_size': 1}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-796473002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a61f2da5-aada-408a-b776-981e5a67cd4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01226b32dcf42749602d000440ad75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:04:50Z,use_quota=True,user_id='59042443602e449d8f1ee923f8210314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Creating volume a61f2da5-aada-408a-b776-981e5a67cd4c {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:04:50 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:04:50 devstack quobyte-client[82616]: System call of process 99135 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:04:50 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=127, name=volume-a61f2da5-aada-408a-b776-981e5a67cd4c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c 1073741824" returned: 0 in 0.370s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c" returned: 0 in 0.084s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] <== create_volume: return (517ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.528s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50196323-b1e2-47ee-953b-46a86b090f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a61f2da5-aada-408a-b776-981e5a67cd4c', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6193b2-3d5e-49b7-9f35-d8d853bc1195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:50 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume volume-a61f2da5-aada-408a-b776-981e5a67cd4c (a61f2da5-aada-408a-b776-981e5a67cd4c): created successfully
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6193b2-3d5e-49b7-9f35-d8d853bc1195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:50 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Flow 'volume_create_manager' (5c9fd624-55ed-4c01-b4f7-3fe81cc531f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:04:50 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-239f3d5b-c727-4c35-8eeb-085b24868799 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Created volume successfully.
Sep 10 12:04:52 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-c377fec4-35d0-4159-88a8-266283c36caf tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:04:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-c377fec4-35d0-4159-88a8-266283c36caf tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:04:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-c377fec4-35d0-4159-88a8-266283c36caf tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:04:52 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-c377fec4-35d0-4159-88a8-266283c36caf tempest-CreateVolumesFromSnapshotTest-1051585810 None] Creating offline snapshot ba8d33b4-bc01-4653-8742-c65118f0a38f of volume a61f2da5-aada-408a-b776-981e5a67cd4c {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 12:04:52 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c27ac2-4f07-4b56-8658-b957cae4691f]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:04:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c377fec4-35d0-4159-88a8-266283c36caf tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:04:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c377fec4-35d0-4159-88a8-266283c36caf tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c" returned: 0 in 0.424s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:04:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c377fec4-35d0-4159-88a8-266283c36caf tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c.ba8d33b4-bc01-4653-8742-c65118f0a38f 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:04:53 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=128, name=volume-a61f2da5-aada-408a-b776-981e5a67cd4c.ba8d33b4-bc01-4653-8742-c65118f0a38f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:04:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c377fec4-35d0-4159-88a8-266283c36caf tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c.ba8d33b4-bc01-4653-8742-c65118f0a38f 1G" returned: 0 in 0.287s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:04:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c377fec4-35d0-4159-88a8-266283c36caf tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a61f2da5-aada-408a-b776-981e5a67cd4c -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c.ba8d33b4-bc01-4653-8742-c65118f0a38f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:04:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c377fec4-35d0-4159-88a8-266283c36caf tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "qemu-img rebase -u -b volume-a61f2da5-aada-408a-b776-981e5a67cd4c -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c.ba8d33b4-bc01-4653-8742-c65118f0a38f" returned: 0 in 0.160s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:04:53 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-c377fec4-35d0-4159-88a8-266283c36caf tempest-CreateVolumesFromSnapshotTest-1051585810 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c.ba8d33b4-bc01-4653-8742-c65118f0a38f is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 12:04:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c377fec4-35d0-4159-88a8-266283c36caf tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c.ba8d33b4-bc01-4653-8742-c65118f0a38f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:04:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c377fec4-35d0-4159-88a8-266283c36caf tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c.ba8d33b4-bc01-4653-8742-c65118f0a38f" returned: 0 in 0.081s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:04:53 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-c377fec4-35d0-4159-88a8-266283c36caf tempest-CreateVolumesFromSnapshotTest-1051585810 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 12:04:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c377fec4-35d0-4159-88a8-266283c36caf tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c.ba8d33b4-bc01-4653-8742-c65118f0a38f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:04:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c377fec4-35d0-4159-88a8-266283c36caf tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c.ba8d33b4-bc01-4653-8742-c65118f0a38f" returned: 0 in 0.120s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:04:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c377fec4-35d0-4159-88a8-266283c36caf tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:04:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c377fec4-35d0-4159-88a8-266283c36caf tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c.info" returned: 0 in 0.094s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:04:53 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-c377fec4-35d0-4159-88a8-266283c36caf tempest-CreateVolumesFromSnapshotTest-1051585810 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c.info is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 12:04:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c377fec4-35d0-4159-88a8-266283c36caf tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:04:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c377fec4-35d0-4159-88a8-266283c36caf tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c.info" returned: 0 in 0.081s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:04:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-c377fec4-35d0-4159-88a8-266283c36caf tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.560s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:04:54 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-c377fec4-35d0-4159-88a8-266283c36caf tempest-CreateVolumesFromSnapshotTest-1051585810 None] Create snapshot completed successfully
Sep 10 12:04:54 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:04:54 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:04:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Flow 'volume_create_manager' (39772c0d-9bdd-4488-8a6b-3c064dc7e9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:04:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d197aab0-1049-4b3b-a588-7859e217c6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d197aab0-1049-4b3b-a588-7859e217c6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1647242466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9805a0-5b54-454c-b694-787876cfc7fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01226b32dcf42749602d000440ad75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:04:55Z,use_quota=True,user_id='59042443602e449d8f1ee923f8210314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783108b9-a38a-4f93-a162-d8f4a36a0b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783108b9-a38a-4f93-a162-d8f4a36a0b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947d9299-0e25-4d3d-b4a9-7112bc140518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947d9299-0e25-4d3d-b4a9-7112bc140518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c9805a0-5b54-454c-b694-787876cfc7fc', 'volume_name': 'volume-9c9805a0-5b54-454c-b694-787876cfc7fc', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff4cea7-9a9e-46d7-bfec-211614fef03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff4cea7-9a9e-46d7-bfec-211614fef03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f63a747-cae4-400f-891e-716ed1abbe66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:54 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume 9c9805a0-5b54-454c-b694-787876cfc7fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c9805a0-5b54-454c-b694-787876cfc7fc', 'volume_size': 1}
Sep 10 12:04:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:04:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:04:55 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1647242466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9805a0-5b54-454c-b694-787876cfc7fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01226b32dcf42749602d000440ad75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:04:55Z,use_quota=True,user_id='59042443602e449d8f1ee923f8210314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:04:55 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Creating volume 9c9805a0-5b54-454c-b694-787876cfc7fc {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:04:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:04:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:04:55 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:04:55 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:04:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:04:55 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:04:55 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:04:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9c9805a0-5b54-454c-b694-787876cfc7fc 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:04:55 devstack quobyte-client[82616]: System call of process 99153 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:04:55 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=130, name=volume-9c9805a0-5b54-454c-b694-787876cfc7fc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:04:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9c9805a0-5b54-454c-b694-787876cfc7fc 1073741824" returned: 0 in 0.559s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:04:55 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:04:55 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:04:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Flow 'volume_create_manager' (0e8d388d-50c5-418f-8e07-873c7b1ec011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:04:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169ce1ed-f45d-452e-8a7d-ca19247b769f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9c9805a0-5b54-454c-b694-787876cfc7fc {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:04:56 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169ce1ed-f45d-452e-8a7d-ca19247b769f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1690547588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e31f3da0-e2dd-4dda-a7f8-2dc76d749f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01226b32dcf42749602d000440ad75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:04:55Z,use_quota=True,user_id='59042443602e449d8f1ee923f8210314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:56 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59734dd5-55f1-49ff-b42b-bcdaa86083ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:56 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59734dd5-55f1-49ff-b42b-bcdaa86083ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:56 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (084cc0db-c3f1-4f13-88fc-7df353128203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:56 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (084cc0db-c3f1-4f13-88fc-7df353128203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e31f3da0-e2dd-4dda-a7f8-2dc76d749f0d', 'volume_name': 'volume-e31f3da0-e2dd-4dda-a7f8-2dc76d749f0d', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:56 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4045f57-5272-41bb-be7f-188100fbb0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:56 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4045f57-5272-41bb-be7f-188100fbb0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:56 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee7d481-3609-4849-99d3-8ae70e2c3359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:56 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume e31f3da0-e2dd-4dda-a7f8-2dc76d749f0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e31f3da0-e2dd-4dda-a7f8-2dc76d749f0d', 'volume_size': 1}
Sep 10 12:04:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:04:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9c9805a0-5b54-454c-b694-787876cfc7fc" returned: 0 in 0.582s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:04:56 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] <== create_volume: return (1324ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:04:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:04:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.066s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:04:56 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1690547588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e31f3da0-e2dd-4dda-a7f8-2dc76d749f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01226b32dcf42749602d000440ad75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:04:55Z,use_quota=True,user_id='59042443602e449d8f1ee923f8210314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:04:56 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Creating volume e31f3da0-e2dd-4dda-a7f8-2dc76d749f0d {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:04:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:04:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:04:56 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:04:56 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:04:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:04:56 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:04:56 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:04:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e31f3da0-e2dd-4dda-a7f8-2dc76d749f0d 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:04:56 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=131, name=volume-e31f3da0-e2dd-4dda-a7f8-2dc76d749f0d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:04:56 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:04:56 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:04:56 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Flow 'volume_create_manager' (e6b57828-9a0f-4584-9f5c-7f0d3ca3a81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bcdd890-3526-4af3-bc80-fdee719cdb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:57 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Flow 'volume_create_manager' (fd3916cf-045c-488a-8274-fff79383b3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f47a84c-e0e0-4d7e-9d3c-f28fdf46f17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f63a747-cae4-400f-891e-716ed1abbe66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c9805a0-5b54-454c-b694-787876cfc7fc', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29b2c6b-3845-4907-bf26-e958f5038066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bcdd890-3526-4af3-bc80-fdee719cdb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-712558970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c0244a4-83c3-44e4-a128-f807af8d20fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01226b32dcf42749602d000440ad75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:04:56Z,use_quota=True,user_id='59042443602e449d8f1ee923f8210314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4259f86-47c9-46a1-b07e-9beef397fa93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4259f86-47c9-46a1-b07e-9beef397fa93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839acea2-12a5-4e73-b1ec-04e39198605c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839acea2-12a5-4e73-b1ec-04e39198605c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c0244a4-83c3-44e4-a128-f807af8d20fe', 'volume_name': 'volume-1c0244a4-83c3-44e4-a128-f807af8d20fe', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82447a4f-1e95-459e-af3c-d87d3e78776a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82447a4f-1e95-459e-af3c-d87d3e78776a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d8f177-6fb9-4c59-ac32-2576f2285c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:57 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume 1c0244a4-83c3-44e4-a128-f807af8d20fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c0244a4-83c3-44e4-a128-f807af8d20fe', 'volume_size': 1}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:04:57 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume volume-9c9805a0-5b54-454c-b694-787876cfc7fc (9c9805a0-5b54-454c-b694-787876cfc7fc): created successfully
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29b2c6b-3845-4907-bf26-e958f5038066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Flow 'volume_create_manager' (39772c0d-9bdd-4488-8a6b-3c064dc7e9c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f47a84c-e0e0-4d7e-9d3c-f28fdf46f17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2144813649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010d7ae7-e3c6-4ad1-b610-e391026b9d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01226b32dcf42749602d000440ad75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:04:56Z,use_quota=True,user_id='59042443602e449d8f1ee923f8210314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8335aa45-1d18-4118-84b6-025b14d6a6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8335aa45-1d18-4118-84b6-025b14d6a6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ca9343-1f50-47a1-aa42-57fbd7298378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ca9343-1f50-47a1-aa42-57fbd7298378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '010d7ae7-e3c6-4ad1-b610-e391026b9d6f', 'volume_name': 'volume-010d7ae7-e3c6-4ad1-b610-e391026b9d6f', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3f6d10-3174-4049-acee-54d7fd560c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3f6d10-3174-4049-acee-54d7fd560c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d9fd02-5f25-45cf-9038-cb7f7b747455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:57 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume 010d7ae7-e3c6-4ad1-b610-e391026b9d6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-010d7ae7-e3c6-4ad1-b610-e391026b9d6f', 'volume_size': 1}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e31f3da0-e2dd-4dda-a7f8-2dc76d749f0d 1073741824" returned: 0 in 0.916s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e31f3da0-e2dd-4dda-a7f8-2dc76d749f0d {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:04:57 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Flow 'volume_create_manager' (93cd45ba-aa99-4761-a209-19fb83f2e13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb6f0d7-f5ac-46e1-aa58-753e9b1d8ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:57 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-9661aa83-e416-41f6-bfd7-0eade47d000d tempest-CreateVolumesFromSnapshotTest-1051585810 None] Created volume successfully.
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e31f3da0-e2dd-4dda-a7f8-2dc76d749f0d" returned: 0 in 0.457s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] <== create_volume: return (1415ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.561s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-712558970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c0244a4-83c3-44e4-a128-f807af8d20fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01226b32dcf42749602d000440ad75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:04:56Z,use_quota=True,user_id='59042443602e449d8f1ee923f8210314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Creating volume 1c0244a4-83c3-44e4-a128-f807af8d20fe {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:04:57 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:04:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1c0244a4-83c3-44e4-a128-f807af8d20fe 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:04:58 devstack quobyte-client[82616]: System call of process 99161 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:04:58 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=132, name=volume-1c0244a4-83c3-44e4-a128-f807af8d20fe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb6f0d7-f5ac-46e1-aa58-753e9b1d8ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-237619156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86c79240-9eef-4aa3-911e-43e3cd245f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01226b32dcf42749602d000440ad75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:04:57Z,use_quota=True,user_id='59042443602e449d8f1ee923f8210314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8108a053-a074-4ef8-96cc-8220fdbe7e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8108a053-a074-4ef8-96cc-8220fdbe7e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21fc2903-b965-482a-8398-e42a813f62f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21fc2903-b965-482a-8398-e42a813f62f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86c79240-9eef-4aa3-911e-43e3cd245f8c', 'volume_name': 'volume-86c79240-9eef-4aa3-911e-43e3cd245f8c', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d920781a-8029-4118-bdae-4e7981262c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d920781a-8029-4118-bdae-4e7981262c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f64b74e-bdbb-4203-af72-fa106384829b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:58 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume 86c79240-9eef-4aa3-911e-43e3cd245f8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86c79240-9eef-4aa3-911e-43e3cd245f8c', 'volume_size': 1}
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee7d481-3609-4849-99d3-8ae70e2c3359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e31f3da0-e2dd-4dda-a7f8-2dc76d749f0d', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d0a6c29-b0de-4f6b-88d9-af36a00774d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1c0244a4-83c3-44e4-a128-f807af8d20fe 1073741824" returned: 0 in 0.528s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1c0244a4-83c3-44e4-a128-f807af8d20fe {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:04:58 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume volume-e31f3da0-e2dd-4dda-a7f8-2dc76d749f0d (e31f3da0-e2dd-4dda-a7f8-2dc76d749f0d): created successfully
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d0a6c29-b0de-4f6b-88d9-af36a00774d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Flow 'volume_create_manager' (0e8d388d-50c5-418f-8e07-873c7b1ec011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1c0244a4-83c3-44e4-a128-f807af8d20fe" returned: 0 in 0.378s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] <== create_volume: return (929ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.449s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2144813649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010d7ae7-e3c6-4ad1-b610-e391026b9d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01226b32dcf42749602d000440ad75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:04:56Z,use_quota=True,user_id='59042443602e449d8f1ee923f8210314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Creating volume 010d7ae7-e3c6-4ad1-b610-e391026b9d6f {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:04:58 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:04:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-010d7ae7-e3c6-4ad1-b610-e391026b9d6f 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:04:58 devstack quobyte-client[82616]: System call of process 99165 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:04:59 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=133, name=volume-010d7ae7-e3c6-4ad1-b610-e391026b9d6f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:04:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d8f177-6fb9-4c59-ac32-2576f2285c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c0244a4-83c3-44e4-a128-f807af8d20fe', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4336ea72-5c0b-43f4-9587-478dcee7ec22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:04:59 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-861a0883-55f3-44f1-9d91-46ec8bcb345a tempest-CreateVolumesFromSnapshotTest-1051585810 None] Created volume successfully.
Sep 10 12:04:59 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume volume-1c0244a4-83c3-44e4-a128-f807af8d20fe (1c0244a4-83c3-44e4-a128-f807af8d20fe): created successfully
Sep 10 12:04:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4336ea72-5c0b-43f4-9587-478dcee7ec22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:04:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Flow 'volume_create_manager' (e6b57828-9a0f-4584-9f5c-7f0d3ca3a81e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:04:59 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-4b298128-378f-4149-88be-61043e1032a0 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Created volume successfully.
Sep 10 12:04:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-010d7ae7-e3c6-4ad1-b610-e391026b9d6f 1073741824" returned: 0 in 0.599s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:04:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-010d7ae7-e3c6-4ad1-b610-e391026b9d6f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:04:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-010d7ae7-e3c6-4ad1-b610-e391026b9d6f" returned: 0 in 0.162s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:04:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] <== create_volume: return (808ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:04:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:04:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.629s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:04:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-237619156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86c79240-9eef-4aa3-911e-43e3cd245f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01226b32dcf42749602d000440ad75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:04:57Z,use_quota=True,user_id='59042443602e449d8f1ee923f8210314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:04:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Creating volume 86c79240-9eef-4aa3-911e-43e3cd245f8c {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:04:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:04:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:04:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:04:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:04:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:04:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:04:59 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:04:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-86c79240-9eef-4aa3-911e-43e3cd245f8c 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:04:59 devstack quobyte-client[82616]: System call of process 99169 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:04:59 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=134, name=volume-86c79240-9eef-4aa3-911e-43e3cd245f8c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:05:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d9fd02-5f25-45cf-9038-cb7f7b747455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-010d7ae7-e3c6-4ad1-b610-e391026b9d6f', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6ad621-6f9e-4a6f-a1ce-df7aeed5c640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:00 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume volume-010d7ae7-e3c6-4ad1-b610-e391026b9d6f (010d7ae7-e3c6-4ad1-b610-e391026b9d6f): created successfully
Sep 10 12:05:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6ad621-6f9e-4a6f-a1ce-df7aeed5c640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Flow 'volume_create_manager' (fd3916cf-045c-488a-8274-fff79383b3a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:05:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-86c79240-9eef-4aa3-911e-43e3cd245f8c 1073741824" returned: 0 in 0.509s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-86c79240-9eef-4aa3-911e-43e3cd245f8c {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-86c79240-9eef-4aa3-911e-43e3cd245f8c" returned: 0 in 0.138s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] <== create_volume: return (698ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:05:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:05:00 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-fd7fd300-3d7c-42ee-9637-e11171ac7f30 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Created volume successfully.
Sep 10 12:05:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f64b74e-bdbb-4203-af72-fa106384829b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86c79240-9eef-4aa3-911e-43e3cd245f8c', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e856587-2fd9-4279-abb4-b2e901aa194e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:00 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume volume-86c79240-9eef-4aa3-911e-43e3cd245f8c (86c79240-9eef-4aa3-911e-43e3cd245f8c): created successfully
Sep 10 12:05:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e856587-2fd9-4279-abb4-b2e901aa194e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Flow 'volume_create_manager' (93cd45ba-aa99-4761-a209-19fb83f2e13d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:05:00 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-3bd9fc6b-f56e-452f-a2b8-e670aea9172e tempest-CreateVolumesFromSnapshotTest-1051585810 None] Created volume successfully.
Sep 10 12:05:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-359a1c3d-823e-4118-89a0-24e2f4af3a55 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "cinder-86c79240-9eef-4aa3-911e-43e3cd245f8c-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-359a1c3d-823e-4118-89a0-24e2f4af3a55 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-86c79240-9eef-4aa3-911e-43e3cd245f8c-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:01 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-359a1c3d-823e-4118-89a0-24e2f4af3a55 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:05:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-359a1c3d-823e-4118-89a0-24e2f4af3a55 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "cinder-quobyte-86c79240-9eef-4aa3-911e-43e3cd245f8c" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-359a1c3d-823e-4118-89a0-24e2f4af3a55 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-quobyte-86c79240-9eef-4aa3-911e-43e3cd245f8c" acquired by "delete_volume" :: waited 0.029s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:01 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2f9d73-8913-448f-bc2e-88c35ec31416]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:05:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-359a1c3d-823e-4118-89a0-24e2f4af3a55 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-86c79240-9eef-4aa3-911e-43e3cd245f8c {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-359a1c3d-823e-4118-89a0-24e2f4af3a55 tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-86c79240-9eef-4aa3-911e-43e3cd245f8c" returned: 0 in 0.513s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-359a1c3d-823e-4118-89a0-24e2f4af3a55 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-86c79240-9eef-4aa3-911e-43e3cd245f8c {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-359a1c3d-823e-4118-89a0-24e2f4af3a55 tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-86c79240-9eef-4aa3-911e-43e3cd245f8c" returned: 0 in 0.097s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:02 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-359a1c3d-823e-4118-89a0-24e2f4af3a55 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-quobyte-86c79240-9eef-4aa3-911e-43e3cd245f8c" released by "delete_volume" :: held 0.782s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:02 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-359a1c3d-823e-4118-89a0-24e2f4af3a55 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Created reservations ['5f843bcf-7a89-4da2-b347-42a6af366fde', '98e3cd32-4dfe-4f2a-9d2b-9905ba4f7c4d', '063a9471-65bd-44bc-b722-ced299ba1a5b', 'a16bd57d-df50-4d34-a00b-266ab6ac6961'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:05:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-359a1c3d-823e-4118-89a0-24e2f4af3a55 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:05:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-359a1c3d-823e-4118-89a0-24e2f4af3a55 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:05:02 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-359a1c3d-823e-4118-89a0-24e2f4af3a55 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:05:02 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-359a1c3d-823e-4118-89a0-24e2f4af3a55 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:05:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-359a1c3d-823e-4118-89a0-24e2f4af3a55 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:05:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-359a1c3d-823e-4118-89a0-24e2f4af3a55 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-359a1c3d-823e-4118-89a0-24e2f4af3a55 tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.108s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:03 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-359a1c3d-823e-4118-89a0-24e2f4af3a55 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:05:03 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-359a1c3d-823e-4118-89a0-24e2f4af3a55 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Deleted volume successfully.
Sep 10 12:05:03 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-359a1c3d-823e-4118-89a0-24e2f4af3a55 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-86c79240-9eef-4aa3-911e-43e3cd245f8c-delete_volume" released by "delete_volume" :: held 2.019s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:03 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-4a228476-c07b-49d7-860e-3dc62c4d5512 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "cinder-010d7ae7-e3c6-4ad1-b610-e391026b9d6f-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:03 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-4a228476-c07b-49d7-860e-3dc62c4d5512 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-010d7ae7-e3c6-4ad1-b610-e391026b9d6f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:03 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-4a228476-c07b-49d7-860e-3dc62c4d5512 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:05:03 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-4a228476-c07b-49d7-860e-3dc62c4d5512 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "cinder-quobyte-010d7ae7-e3c6-4ad1-b610-e391026b9d6f" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:03 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-4a228476-c07b-49d7-860e-3dc62c4d5512 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-quobyte-010d7ae7-e3c6-4ad1-b610-e391026b9d6f" acquired by "delete_volume" :: waited 0.014s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:03 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aea35ea-344d-45c5-bdf7-3ff62b0ca061]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:05:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4a228476-c07b-49d7-860e-3dc62c4d5512 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-010d7ae7-e3c6-4ad1-b610-e391026b9d6f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4a228476-c07b-49d7-860e-3dc62c4d5512 tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-010d7ae7-e3c6-4ad1-b610-e391026b9d6f" returned: 0 in 0.417s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4a228476-c07b-49d7-860e-3dc62c4d5512 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-010d7ae7-e3c6-4ad1-b610-e391026b9d6f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4a228476-c07b-49d7-860e-3dc62c4d5512 tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-010d7ae7-e3c6-4ad1-b610-e391026b9d6f" returned: 0 in 0.090s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:04 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-4a228476-c07b-49d7-860e-3dc62c4d5512 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-quobyte-010d7ae7-e3c6-4ad1-b610-e391026b9d6f" released by "delete_volume" :: held 0.647s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:04 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-4a228476-c07b-49d7-860e-3dc62c4d5512 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Created reservations ['6cb11250-a86d-4ec1-893d-f4cdec2c6db9', '65167fb3-bfca-4bf6-b76e-5a13db38499b', 'd88a959e-d782-4eb6-9842-8eefe41383d3', '44275716-3336-4ec5-9462-deeb9944f10d'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:05:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4a228476-c07b-49d7-860e-3dc62c4d5512 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:05:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4a228476-c07b-49d7-860e-3dc62c4d5512 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:05:04 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4a228476-c07b-49d7-860e-3dc62c4d5512 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:05:04 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-4a228476-c07b-49d7-860e-3dc62c4d5512 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:05:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-4a228476-c07b-49d7-860e-3dc62c4d5512 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:05:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4a228476-c07b-49d7-860e-3dc62c4d5512 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-4a228476-c07b-49d7-860e-3dc62c4d5512 tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.098s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:05 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-4a228476-c07b-49d7-860e-3dc62c4d5512 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:05:05 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-4a228476-c07b-49d7-860e-3dc62c4d5512 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Deleted volume successfully.
Sep 10 12:05:05 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-4a228476-c07b-49d7-860e-3dc62c4d5512 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-010d7ae7-e3c6-4ad1-b610-e391026b9d6f-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:05 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2f9eeb66-ab83-4e5e-939e-836a4a3b9ea9 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "cinder-1c0244a4-83c3-44e4-a128-f807af8d20fe-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:05 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2f9eeb66-ab83-4e5e-939e-836a4a3b9ea9 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-1c0244a4-83c3-44e4-a128-f807af8d20fe-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:06 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-2f9eeb66-ab83-4e5e-939e-836a4a3b9ea9 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:05:06 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2f9eeb66-ab83-4e5e-939e-836a4a3b9ea9 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "cinder-quobyte-1c0244a4-83c3-44e4-a128-f807af8d20fe" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:06 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2f9eeb66-ab83-4e5e-939e-836a4a3b9ea9 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-quobyte-1c0244a4-83c3-44e4-a128-f807af8d20fe" acquired by "delete_volume" :: waited 0.011s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:06 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[03421aa7-0411-4b71-93fc-6753f993049f]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:05:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2f9eeb66-ab83-4e5e-939e-836a4a3b9ea9 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1c0244a4-83c3-44e4-a128-f807af8d20fe {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2f9eeb66-ab83-4e5e-939e-836a4a3b9ea9 tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1c0244a4-83c3-44e4-a128-f807af8d20fe" returned: 0 in 0.406s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2f9eeb66-ab83-4e5e-939e-836a4a3b9ea9 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1c0244a4-83c3-44e4-a128-f807af8d20fe {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2f9eeb66-ab83-4e5e-939e-836a4a3b9ea9 tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-1c0244a4-83c3-44e4-a128-f807af8d20fe" returned: 0 in 0.113s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:06 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2f9eeb66-ab83-4e5e-939e-836a4a3b9ea9 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-quobyte-1c0244a4-83c3-44e4-a128-f807af8d20fe" released by "delete_volume" :: held 0.720s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:07 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-2f9eeb66-ab83-4e5e-939e-836a4a3b9ea9 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Created reservations ['aa81d36a-e487-46bb-a507-f99de57e19f0', '27c6b78b-36d1-4423-96b2-e0540ebb399a', '17a5dfac-e2a4-4d6c-a971-389b32742dab', '57a3fdee-29a0-4471-97f1-b18ba2377725'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:05:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2f9eeb66-ab83-4e5e-939e-836a4a3b9ea9 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:05:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2f9eeb66-ab83-4e5e-939e-836a4a3b9ea9 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:05:07 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2f9eeb66-ab83-4e5e-939e-836a4a3b9ea9 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:05:07 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2f9eeb66-ab83-4e5e-939e-836a4a3b9ea9 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:05:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2f9eeb66-ab83-4e5e-939e-836a4a3b9ea9 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:05:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2f9eeb66-ab83-4e5e-939e-836a4a3b9ea9 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2f9eeb66-ab83-4e5e-939e-836a4a3b9ea9 tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.120s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:07 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-2f9eeb66-ab83-4e5e-939e-836a4a3b9ea9 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:05:07 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-2f9eeb66-ab83-4e5e-939e-836a4a3b9ea9 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Deleted volume successfully.
Sep 10 12:05:07 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2f9eeb66-ab83-4e5e-939e-836a4a3b9ea9 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-1c0244a4-83c3-44e4-a128-f807af8d20fe-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fe6b3580-9624-4c16-9076-53ae3f6a394b tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "cinder-e31f3da0-e2dd-4dda-a7f8-2dc76d749f0d-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fe6b3580-9624-4c16-9076-53ae3f6a394b tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-e31f3da0-e2dd-4dda-a7f8-2dc76d749f0d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:08 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-fe6b3580-9624-4c16-9076-53ae3f6a394b tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:05:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fe6b3580-9624-4c16-9076-53ae3f6a394b tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "cinder-quobyte-e31f3da0-e2dd-4dda-a7f8-2dc76d749f0d" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fe6b3580-9624-4c16-9076-53ae3f6a394b tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-quobyte-e31f3da0-e2dd-4dda-a7f8-2dc76d749f0d" acquired by "delete_volume" :: waited 0.015s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:08 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fa00c7-d396-44e6-a1eb-5dcdcc9f6a36]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:05:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fe6b3580-9624-4c16-9076-53ae3f6a394b tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e31f3da0-e2dd-4dda-a7f8-2dc76d749f0d {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fe6b3580-9624-4c16-9076-53ae3f6a394b tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e31f3da0-e2dd-4dda-a7f8-2dc76d749f0d" returned: 0 in 0.395s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fe6b3580-9624-4c16-9076-53ae3f6a394b tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e31f3da0-e2dd-4dda-a7f8-2dc76d749f0d {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fe6b3580-9624-4c16-9076-53ae3f6a394b tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e31f3da0-e2dd-4dda-a7f8-2dc76d749f0d" returned: 0 in 0.107s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:09 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fe6b3580-9624-4c16-9076-53ae3f6a394b tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-quobyte-e31f3da0-e2dd-4dda-a7f8-2dc76d749f0d" released by "delete_volume" :: held 0.649s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:09 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-fe6b3580-9624-4c16-9076-53ae3f6a394b tempest-CreateVolumesFromSnapshotTest-1051585810 None] Created reservations ['2132a30c-722c-4715-8ed4-21289e3b0675', '45c506b2-2b63-47b3-8d43-2d6177c34066', '2f743c1f-f188-42b7-bc14-ab7538bc4ade', 'fb0a3b3e-6415-41b6-8e81-5c6ee94cc30e'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:05:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fe6b3580-9624-4c16-9076-53ae3f6a394b tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:05:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fe6b3580-9624-4c16-9076-53ae3f6a394b tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:05:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fe6b3580-9624-4c16-9076-53ae3f6a394b tempest-CreateVolumesFromSnapshotTest-1051585810 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:05:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fe6b3580-9624-4c16-9076-53ae3f6a394b tempest-CreateVolumesFromSnapshotTest-1051585810 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:05:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fe6b3580-9624-4c16-9076-53ae3f6a394b tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:05:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fe6b3580-9624-4c16-9076-53ae3f6a394b tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fe6b3580-9624-4c16-9076-53ae3f6a394b tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.089s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:09 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-fe6b3580-9624-4c16-9076-53ae3f6a394b tempest-CreateVolumesFromSnapshotTest-1051585810 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:05:09 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-fe6b3580-9624-4c16-9076-53ae3f6a394b tempest-CreateVolumesFromSnapshotTest-1051585810 None] Deleted volume successfully.
Sep 10 12:05:09 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fe6b3580-9624-4c16-9076-53ae3f6a394b tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-e31f3da0-e2dd-4dda-a7f8-2dc76d749f0d-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:10 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b0c6e9c7-86fb-4642-aa58-06a1dd935baa tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "cinder-9c9805a0-5b54-454c-b694-787876cfc7fc-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:10 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b0c6e9c7-86fb-4642-aa58-06a1dd935baa tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-9c9805a0-5b54-454c-b694-787876cfc7fc-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:10 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-b0c6e9c7-86fb-4642-aa58-06a1dd935baa tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:05:10 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b0c6e9c7-86fb-4642-aa58-06a1dd935baa tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "cinder-quobyte-9c9805a0-5b54-454c-b694-787876cfc7fc" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:10 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b0c6e9c7-86fb-4642-aa58-06a1dd935baa tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-quobyte-9c9805a0-5b54-454c-b694-787876cfc7fc" acquired by "delete_volume" :: waited 0.011s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:10 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a134eb-4f1c-4c80-875c-5489acb313a1]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:05:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b0c6e9c7-86fb-4642-aa58-06a1dd935baa tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9c9805a0-5b54-454c-b694-787876cfc7fc {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b0c6e9c7-86fb-4642-aa58-06a1dd935baa tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9c9805a0-5b54-454c-b694-787876cfc7fc" returned: 0 in 0.385s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b0c6e9c7-86fb-4642-aa58-06a1dd935baa tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9c9805a0-5b54-454c-b694-787876cfc7fc {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b0c6e9c7-86fb-4642-aa58-06a1dd935baa tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9c9805a0-5b54-454c-b694-787876cfc7fc" returned: 0 in 0.103s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:11 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b0c6e9c7-86fb-4642-aa58-06a1dd935baa tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-quobyte-9c9805a0-5b54-454c-b694-787876cfc7fc" released by "delete_volume" :: held 0.632s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:11 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-b0c6e9c7-86fb-4642-aa58-06a1dd935baa tempest-CreateVolumesFromSnapshotTest-1051585810 None] Created reservations ['85863003-1835-4a79-8aab-5b58de4b94d1', 'f0eb8f50-0e6c-4cea-b753-ba6291d44fa6', '4f574070-b8c8-48c5-839b-942330298a24', '284fa07f-b846-4810-b745-9d7aad077f07'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:05:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b0c6e9c7-86fb-4642-aa58-06a1dd935baa tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:05:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b0c6e9c7-86fb-4642-aa58-06a1dd935baa tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:05:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b0c6e9c7-86fb-4642-aa58-06a1dd935baa tempest-CreateVolumesFromSnapshotTest-1051585810 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:05:11 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b0c6e9c7-86fb-4642-aa58-06a1dd935baa tempest-CreateVolumesFromSnapshotTest-1051585810 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:05:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b0c6e9c7-86fb-4642-aa58-06a1dd935baa tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:05:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b0c6e9c7-86fb-4642-aa58-06a1dd935baa tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b0c6e9c7-86fb-4642-aa58-06a1dd935baa tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.086s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:11 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-b0c6e9c7-86fb-4642-aa58-06a1dd935baa tempest-CreateVolumesFromSnapshotTest-1051585810 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:05:12 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-b0c6e9c7-86fb-4642-aa58-06a1dd935baa tempest-CreateVolumesFromSnapshotTest-1051585810 None] Deleted volume successfully.
Sep 10 12:05:12 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b0c6e9c7-86fb-4642-aa58-06a1dd935baa tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-9c9805a0-5b54-454c-b694-787876cfc7fc-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:12 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bda09d5d-23c7-41bf-b9ba-9654e9a12598 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "cinder-ba8d33b4-bc01-4653-8742-c65118f0a38f-delete_snapshot" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:12 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bda09d5d-23c7-41bf-b9ba-9654e9a12598 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-ba8d33b4-bc01-4653-8742-c65118f0a38f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:12 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-bda09d5d-23c7-41bf-b9ba-9654e9a12598 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:05:12 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bda09d5d-23c7-41bf-b9ba-9654e9a12598 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "cinder-quobyte-a61f2da5-aada-408a-b776-981e5a67cd4c" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:12 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bda09d5d-23c7-41bf-b9ba-9654e9a12598 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-quobyte-a61f2da5-aada-408a-b776-981e5a67cd4c" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:12 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bda09d5d-23c7-41bf-b9ba-9654e9a12598 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "cinder-quobyte-ba8d33b4-bc01-4653-8742-c65118f0a38f" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:12 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bda09d5d-23c7-41bf-b9ba-9654e9a12598 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-quobyte-ba8d33b4-bc01-4653-8742-c65118f0a38f" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:12 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-bda09d5d-23c7-41bf-b9ba-9654e9a12598 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Deleting offline snapshot ba8d33b4-bc01-4653-8742-c65118f0a38f of volume a61f2da5-aada-408a-b776-981e5a67cd4c {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 12:05:12 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-bda09d5d-23c7-41bf-b9ba-9654e9a12598 tempest-CreateVolumesFromSnapshotTest-1051585810 None] snapshot_file for this snap is: volume-a61f2da5-aada-408a-b776-981e5a67cd4c.ba8d33b4-bc01-4653-8742-c65118f0a38f {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 12:05:13 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f0544d-ac0c-4dd3-a7a1-75c5f3ce4b5c]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:05:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bda09d5d-23c7-41bf-b9ba-9654e9a12598 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c.ba8d33b4-bc01-4653-8742-c65118f0a38f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bda09d5d-23c7-41bf-b9ba-9654e9a12598 tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c.ba8d33b4-bc01-4653-8742-c65118f0a38f" returned: 0 in 0.423s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:13 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-bda09d5d-23c7-41bf-b9ba-9654e9a12598 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a61f2da5-aada-408a-b776-981e5a67cd4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 12:05:13 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ffbe85-56cf-4951-9bbb-fa42619a51f8]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:05:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bda09d5d-23c7-41bf-b9ba-9654e9a12598 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bda09d5d-23c7-41bf-b9ba-9654e9a12598 tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c" returned: 0 in 0.401s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bda09d5d-23c7-41bf-b9ba-9654e9a12598 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c.ba8d33b4-bc01-4653-8742-c65118f0a38f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bda09d5d-23c7-41bf-b9ba-9654e9a12598 tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c.ba8d33b4-bc01-4653-8742-c65118f0a38f" returned: 0 in 0.272s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bda09d5d-23c7-41bf-b9ba-9654e9a12598 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c.ba8d33b4-bc01-4653-8742-c65118f0a38f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bda09d5d-23c7-41bf-b9ba-9654e9a12598 tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c.ba8d33b4-bc01-4653-8742-c65118f0a38f" returned: 0 in 0.093s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:14 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bda09d5d-23c7-41bf-b9ba-9654e9a12598 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-quobyte-ba8d33b4-bc01-4653-8742-c65118f0a38f" released by "_delete_snapshot" :: held 1.533s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:14 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bda09d5d-23c7-41bf-b9ba-9654e9a12598 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-quobyte-a61f2da5-aada-408a-b776-981e5a67cd4c" released by "delete_snapshot" :: held 1.559s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:14 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-bda09d5d-23c7-41bf-b9ba-9654e9a12598 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Created reservations ['eca5e47e-f61e-4668-901f-72d3ac041a4a', '53ba25bd-3648-412c-ba32-5d82e239c598', 'c4e02875-35ba-457e-a023-c76793c05afa', '555cfae6-9383-4ff8-9957-734862399ae4'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:05:14 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-bda09d5d-23c7-41bf-b9ba-9654e9a12598 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Delete snapshot completed successfully.
Sep 10 12:05:14 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-bda09d5d-23c7-41bf-b9ba-9654e9a12598 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-ba8d33b4-bc01-4653-8742-c65118f0a38f-delete_snapshot" released by "delete_snapshot" :: held 2.041s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:15 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d0521fed-0342-4e6f-9bca-25fc1f7c60d1 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "cinder-a61f2da5-aada-408a-b776-981e5a67cd4c-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:15 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d0521fed-0342-4e6f-9bca-25fc1f7c60d1 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-a61f2da5-aada-408a-b776-981e5a67cd4c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:15 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-d0521fed-0342-4e6f-9bca-25fc1f7c60d1 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:05:15 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d0521fed-0342-4e6f-9bca-25fc1f7c60d1 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "cinder-quobyte-a61f2da5-aada-408a-b776-981e5a67cd4c" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:15 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d0521fed-0342-4e6f-9bca-25fc1f7c60d1 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-quobyte-a61f2da5-aada-408a-b776-981e5a67cd4c" acquired by "delete_volume" :: waited 0.011s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:15 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9b06e8-7ac0-4cc3-b41c-38d593398245]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:05:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d0521fed-0342-4e6f-9bca-25fc1f7c60d1 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d0521fed-0342-4e6f-9bca-25fc1f7c60d1 tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c" returned: 0 in 0.410s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d0521fed-0342-4e6f-9bca-25fc1f7c60d1 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d0521fed-0342-4e6f-9bca-25fc1f7c60d1 tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-a61f2da5-aada-408a-b776-981e5a67cd4c" returned: 0 in 0.111s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d0521fed-0342-4e6f-9bca-25fc1f7c60d1 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-quobyte-a61f2da5-aada-408a-b776-981e5a67cd4c" released by "delete_volume" :: held 0.678s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:16 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-d0521fed-0342-4e6f-9bca-25fc1f7c60d1 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Created reservations ['fd288c87-d5e9-46e7-be4d-6064e4e855a8', '5f16de43-df7d-4ed8-8730-5e08f243b5a2', '91beffb9-0379-4147-8a6e-c6bc5b5de9ff', 'e6b99789-c15b-4a9a-af84-b05d1e474346'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:05:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d0521fed-0342-4e6f-9bca-25fc1f7c60d1 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:05:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d0521fed-0342-4e6f-9bca-25fc1f7c60d1 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:05:16 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d0521fed-0342-4e6f-9bca-25fc1f7c60d1 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:05:16 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-d0521fed-0342-4e6f-9bca-25fc1f7c60d1 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:05:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-d0521fed-0342-4e6f-9bca-25fc1f7c60d1 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:05:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d0521fed-0342-4e6f-9bca-25fc1f7c60d1 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-d0521fed-0342-4e6f-9bca-25fc1f7c60d1 tempest-CreateVolumesFromSnapshotTest-1051585810 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.169s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:16 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-d0521fed-0342-4e6f-9bca-25fc1f7c60d1 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:05:16 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-d0521fed-0342-4e6f-9bca-25fc1f7c60d1 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Deleted volume successfully.
Sep 10 12:05:17 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-d0521fed-0342-4e6f-9bca-25fc1f7c60d1 tempest-CreateVolumesFromSnapshotTest-1051585810 None] Lock "cinder-a61f2da5-aada-408a-b776-981e5a67cd4c-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:21 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:05:21 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:05:21 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Flow 'volume_create_manager' (c923b7df-0ead-43d8-bb9f-a00450296be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:05:21 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98bb9e76-b34a-4219-9248-b3b9f3f62446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:21 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98bb9e76-b34a-4219-9248-b3b9f3f62446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-866574207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c776b48-923e-4df0-bc26-7bb477ab3781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed91b981b704add9688df2725622e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:05:21Z,use_quota=True,user_id='fae5387a09644074a88e8d0d0d0eb602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:21 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e53e7e-ba08-493f-90f4-db2211175123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:21 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e53e7e-ba08-493f-90f4-db2211175123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:21 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f34189-7072-4583-b3db-01ab120b1d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:21 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f34189-7072-4583-b3db-01ab120b1d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c776b48-923e-4df0-bc26-7bb477ab3781', 'volume_name': 'volume-9c776b48-923e-4df0-bc26-7bb477ab3781', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:21 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a4161a5-851c-425b-9afd-85b47786073b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:21 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a4161a5-851c-425b-9afd-85b47786073b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:21 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15fe4709-a578-46fb-94a5-4f6690be14cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:21 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume 9c776b48-923e-4df0-bc26-7bb477ab3781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c776b48-923e-4df0-bc26-7bb477ab3781', 'volume_size': 1}
Sep 10 12:05:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:05:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:05:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-866574207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c776b48-923e-4df0-bc26-7bb477ab3781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed91b981b704add9688df2725622e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:05:21Z,use_quota=True,user_id='fae5387a09644074a88e8d0d0d0eb602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:05:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Creating volume 9c776b48-923e-4df0-bc26-7bb477ab3781 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:05:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:05:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:05:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:05:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:05:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:05:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:05:21 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:05:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9c776b48-923e-4df0-bc26-7bb477ab3781 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:21 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=135, name=volume-9c776b48-923e-4df0-bc26-7bb477ab3781, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:05:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9c776b48-923e-4df0-bc26-7bb477ab3781 1073741824" returned: 0 in 0.399s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9c776b48-923e-4df0-bc26-7bb477ab3781 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9c776b48-923e-4df0-bc26-7bb477ab3781" returned: 0 in 0.102s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] <== create_volume: return (581ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:05:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.598s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:05:22 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15fe4709-a578-46fb-94a5-4f6690be14cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c776b48-923e-4df0-bc26-7bb477ab3781', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:22 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c61c2a-064e-4a79-b6ae-f83e2d1ba5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:22 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume volume-9c776b48-923e-4df0-bc26-7bb477ab3781 (9c776b48-923e-4df0-bc26-7bb477ab3781): created successfully
Sep 10 12:05:22 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c61c2a-064e-4a79-b6ae-f83e2d1ba5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:22 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Flow 'volume_create_manager' (c923b7df-0ead-43d8-bb9f-a00450296be7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:05:22 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-9c5a3eba-4c43-4849-b6e7-cc3aadaca015 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Created volume successfully.
Sep 10 12:05:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 12:05:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:05:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:05:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:05:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:05:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:05:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.112s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:22 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:05:24 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:05:24 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:05:24 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Flow 'volume_create_manager' (b920863d-4a06-4b1b-ab41-fcef81ec48f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:05:24 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (466c3d2f-ce13-49a4-b9d0-ca5eebe65e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:24 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (466c3d2f-ce13-49a4-b9d0-ca5eebe65e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1689356591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d5d8757-a942-4388-9468-0768e63374c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed91b981b704add9688df2725622e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:05:24Z,use_quota=True,user_id='fae5387a09644074a88e8d0d0d0eb602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:24 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f471443b-575a-4fe4-ac7b-1752085cf1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:24 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f471443b-575a-4fe4-ac7b-1752085cf1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:24 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7557f70a-23ea-4a8a-8c1f-8c7824d86a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:24 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7557f70a-23ea-4a8a-8c1f-8c7824d86a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d5d8757-a942-4388-9468-0768e63374c9', 'volume_name': 'volume-4d5d8757-a942-4388-9468-0768e63374c9', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:24 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a7c6a6-e004-451e-8429-c7a37756f7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:24 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a7c6a6-e004-451e-8429-c7a37756f7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:24 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ee0a9d-ce97-43ec-a963-cbfad8aa0116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:24 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume 4d5d8757-a942-4388-9468-0768e63374c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d5d8757-a942-4388-9468-0768e63374c9', 'volume_size': 1}
Sep 10 12:05:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:05:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:05:24 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1689356591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d5d8757-a942-4388-9468-0768e63374c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed91b981b704add9688df2725622e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:05:24Z,use_quota=True,user_id='fae5387a09644074a88e8d0d0d0eb602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:05:24 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Creating volume 4d5d8757-a942-4388-9468-0768e63374c9 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:05:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:05:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:05:24 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:05:24 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:05:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:05:24 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:05:24 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:05:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4d5d8757-a942-4388-9468-0768e63374c9 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:24 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:05:24 devstack quobyte-client[82616]: System call of process 99255 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:05:24 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:05:24 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=136, name=volume-4d5d8757-a942-4388-9468-0768e63374c9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:05:24 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Flow 'volume_create_manager' (d131debf-948a-4327-887a-969dfdafb483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:05:24 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb442de-d3f7-4103-a157-7164e73ce5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb442de-d3f7-4103-a157-7164e73ce5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1847448287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb37228-8a04-44f5-8941-ee6dbae27836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed91b981b704add9688df2725622e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:05:24Z,use_quota=True,user_id='fae5387a09644074a88e8d0d0d0eb602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4180d31d-d531-4ada-81f9-3760549e8296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4180d31d-d531-4ada-81f9-3760549e8296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4a2496-2909-4ef3-a524-6386cb27566d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4a2496-2909-4ef3-a524-6386cb27566d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beb37228-8a04-44f5-8941-ee6dbae27836', 'volume_name': 'volume-beb37228-8a04-44f5-8941-ee6dbae27836', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84407739-6a9b-4ce0-a840-2850000242e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84407739-6a9b-4ce0-a840-2850000242e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfda5297-a952-4737-81ca-98ac168d5b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:25 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume beb37228-8a04-44f5-8941-ee6dbae27836: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beb37228-8a04-44f5-8941-ee6dbae27836', 'volume_size': 1}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4d5d8757-a942-4388-9468-0768e63374c9 1073741824" returned: 0 in 0.802s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4d5d8757-a942-4388-9468-0768e63374c9 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:25 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Flow 'volume_create_manager' (23009394-19f5-4050-aad9-e65e5f415560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb5ef17-6a66-430c-9810-8cc5b06b6a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4d5d8757-a942-4388-9468-0768e63374c9" returned: 0 in 0.674s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] <== create_volume: return (1498ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb5ef17-6a66-430c-9810-8cc5b06b6a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-246287336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d937947c-28f7-4fd7-8f1f-6101d8031722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed91b981b704add9688df2725622e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:05:25Z,use_quota=True,user_id='fae5387a09644074a88e8d0d0d0eb602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75dc0140-cf34-45a6-808e-b647752570cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75dc0140-cf34-45a6-808e-b647752570cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (648bd6b1-34ac-4a9e-b36c-0e12ff1fac3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (648bd6b1-34ac-4a9e-b36c-0e12ff1fac3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd937947c-28f7-4fd7-8f1f-6101d8031722', 'volume_name': 'volume-d937947c-28f7-4fd7-8f1f-6101d8031722', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c15fd9-9452-4dee-9bd2-c7d0c0c0c4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c15fd9-9452-4dee-9bd2-c7d0c0c0c4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5df092-2f92-46ee-99af-d9d7e3a333c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:25 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume d937947c-28f7-4fd7-8f1f-6101d8031722: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d937947c-28f7-4fd7-8f1f-6101d8031722', 'volume_size': 1}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-246287336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d937947c-28f7-4fd7-8f1f-6101d8031722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed91b981b704add9688df2725622e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:05:25Z,use_quota=True,user_id='fae5387a09644074a88e8d0d0d0eb602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Creating volume d937947c-28f7-4fd7-8f1f-6101d8031722 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:05:25 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:05:26 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-d937947c-28f7-4fd7-8f1f-6101d8031722 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:26 devstack quobyte-client[82616]: System call of process 99259 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:05:26 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=137, name=volume-d937947c-28f7-4fd7-8f1f-6101d8031722, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:05:26 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Flow 'volume_create_manager' (f939d3b9-3008-47bb-a9f2-860907483faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a96cd3-fb6b-4c25-a50a-e2f115b28838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ee0a9d-ce97-43ec-a963-cbfad8aa0116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d5d8757-a942-4388-9468-0768e63374c9', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2148bcbc-9fc5-4b42-87df-76acfac6a2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:26 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Flow 'volume_create_manager' (f73ed9bc-412c-4cc2-bc90-c88b2d30050e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9a6a24-4427-4d74-8356-a603fdaae037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a96cd3-fb6b-4c25-a50a-e2f115b28838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2060668374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52ab40a4-bff3-4584-880a-51c8703f750f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed91b981b704add9688df2725622e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:05:25Z,use_quota=True,user_id='fae5387a09644074a88e8d0d0d0eb602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1bbf6d1-b835-4cc0-bd04-787c9861c11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1bbf6d1-b835-4cc0-bd04-787c9861c11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f735d11-0613-4938-bcd4-dab71188710a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f735d11-0613-4938-bcd4-dab71188710a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52ab40a4-bff3-4584-880a-51c8703f750f', 'volume_name': 'volume-52ab40a4-bff3-4584-880a-51c8703f750f', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a602a5-b879-42a9-b016-b6011fb06832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a602a5-b879-42a9-b016-b6011fb06832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c5ea74d-a821-4bbf-b58d-cf76e0dd108e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:26 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume 52ab40a4-bff3-4584-880a-51c8703f750f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52ab40a4-bff3-4584-880a-51c8703f750f', 'volume_size': 1}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-d937947c-28f7-4fd7-8f1f-6101d8031722 1073741824" returned: 0 in 0.690s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-d937947c-28f7-4fd7-8f1f-6101d8031722 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9a6a24-4427-4d74-8356-a603fdaae037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1732805258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc14991e-ffd1-4db2-ab64-99c0883e5820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed91b981b704add9688df2725622e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:05:26Z,use_quota=True,user_id='fae5387a09644074a88e8d0d0d0eb602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c18a3e8-8e86-40d5-88e8-ef95f1b0e63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c18a3e8-8e86-40d5-88e8-ef95f1b0e63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22adb59-a222-4c98-a5c8-f42310ab23c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22adb59-a222-4c98-a5c8-f42310ab23c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc14991e-ffd1-4db2-ab64-99c0883e5820', 'volume_name': 'volume-dc14991e-ffd1-4db2-ab64-99c0883e5820', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca45011-7858-402d-909d-8059260d588b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca45011-7858-402d-909d-8059260d588b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81caf92-3db9-4586-9e93-3673dd806878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:26 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume dc14991e-ffd1-4db2-ab64-99c0883e5820: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc14991e-ffd1-4db2-ab64-99c0883e5820', 'volume_size': 1}
Sep 10 12:05:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:05:27 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume volume-4d5d8757-a942-4388-9468-0768e63374c9 (4d5d8757-a942-4388-9468-0768e63374c9): created successfully
Sep 10 12:05:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2148bcbc-9fc5-4b42-87df-76acfac6a2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Flow 'volume_create_manager' (b920863d-4a06-4b1b-ab41-fcef81ec48f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:05:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-d937947c-28f7-4fd7-8f1f-6101d8031722" returned: 0 in 0.435s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] <== create_volume: return (1151ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:05:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:05:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.943s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:05:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1847448287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb37228-8a04-44f5-8941-ee6dbae27836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed91b981b704add9688df2725622e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:05:24Z,use_quota=True,user_id='fae5387a09644074a88e8d0d0d0eb602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:05:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Creating volume beb37228-8a04-44f5-8941-ee6dbae27836 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:05:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:05:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:05:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:05:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:05:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:05:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:05:27 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:05:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-beb37228-8a04-44f5-8941-ee6dbae27836 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:27 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-e4278222-0c69-4a71-8e27-446198f8dd4d tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Created volume successfully.
Sep 10 12:05:27 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=138, name=volume-beb37228-8a04-44f5-8941-ee6dbae27836, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:05:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5df092-2f92-46ee-99af-d9d7e3a333c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d937947c-28f7-4fd7-8f1f-6101d8031722', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18b7c53-93c4-46b0-9b77-1ddc1eeb00dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-beb37228-8a04-44f5-8941-ee6dbae27836 1073741824" returned: 0 in 0.478s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-beb37228-8a04-44f5-8941-ee6dbae27836 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:27 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume volume-d937947c-28f7-4fd7-8f1f-6101d8031722 (d937947c-28f7-4fd7-8f1f-6101d8031722): created successfully
Sep 10 12:05:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18b7c53-93c4-46b0-9b77-1ddc1eeb00dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Flow 'volume_create_manager' (23009394-19f5-4050-aad9-e65e5f415560) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:05:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-beb37228-8a04-44f5-8941-ee6dbae27836" returned: 0 in 0.418s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] <== create_volume: return (922ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:05:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:05:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.415s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:05:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2060668374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52ab40a4-bff3-4584-880a-51c8703f750f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed91b981b704add9688df2725622e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:05:25Z,use_quota=True,user_id='fae5387a09644074a88e8d0d0d0eb602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:05:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Creating volume 52ab40a4-bff3-4584-880a-51c8703f750f {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:05:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:05:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:05:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:05:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:05:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:05:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:05:28 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:05:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-52ab40a4-bff3-4584-880a-51c8703f750f 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:28 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-29afcfb0-61b3-4e13-a7e5-6029ee3fd074 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Created volume successfully.
Sep 10 12:05:28 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=139, name=volume-52ab40a4-bff3-4584-880a-51c8703f750f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:05:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfda5297-a952-4737-81ca-98ac168d5b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beb37228-8a04-44f5-8941-ee6dbae27836', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9325d7dc-dbc1-4abe-a33b-340b9bd969aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:28 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume volume-beb37228-8a04-44f5-8941-ee6dbae27836 (beb37228-8a04-44f5-8941-ee6dbae27836): created successfully
Sep 10 12:05:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9325d7dc-dbc1-4abe-a33b-340b9bd969aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:28 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Flow 'volume_create_manager' (d131debf-948a-4327-887a-969dfdafb483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:05:28 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-fc6ff8b2-1812-4c78-9cc1-85aed19da4c1 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Created volume successfully.
Sep 10 12:05:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-52ab40a4-bff3-4584-880a-51c8703f750f 1073741824" returned: 0 in 0.681s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-52ab40a4-bff3-4584-880a-51c8703f750f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-52ab40a4-bff3-4584-880a-51c8703f750f" returned: 0 in 0.154s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] <== create_volume: return (900ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:05:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:05:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.179s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:05:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1732805258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc14991e-ffd1-4db2-ab64-99c0883e5820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed91b981b704add9688df2725622e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:05:26Z,use_quota=True,user_id='fae5387a09644074a88e8d0d0d0eb602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:05:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Creating volume dc14991e-ffd1-4db2-ab64-99c0883e5820 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:05:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:05:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:05:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:05:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:05:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:05:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:05:29 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:05:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-dc14991e-ffd1-4db2-ab64-99c0883e5820 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:29 devstack quobyte-client[82616]: System call of process 99271 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:05:29 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=140, name=volume-dc14991e-ffd1-4db2-ab64-99c0883e5820, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:05:29 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c5ea74d-a821-4bbf-b58d-cf76e0dd108e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52ab40a4-bff3-4584-880a-51c8703f750f', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:29 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7e09ee-6013-4f6d-805e-98176ce349dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-dc14991e-ffd1-4db2-ab64-99c0883e5820 1073741824" returned: 0 in 0.517s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-dc14991e-ffd1-4db2-ab64-99c0883e5820 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:29 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume volume-52ab40a4-bff3-4584-880a-51c8703f750f (52ab40a4-bff3-4584-880a-51c8703f750f): created successfully
Sep 10 12:05:29 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7e09ee-6013-4f6d-805e-98176ce349dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Flow 'volume_create_manager' (f939d3b9-3008-47bb-a9f2-860907483faa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:05:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-dc14991e-ffd1-4db2-ab64-99c0883e5820" returned: 0 in 0.437s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:30 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] <== create_volume: return (986ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:05:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:05:30 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-24a6d96a-2f4f-44a1-8f6e-a2fb4f883fef tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Created volume successfully.
Sep 10 12:05:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81caf92-3db9-4586-9e93-3673dd806878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc14991e-ffd1-4db2-ab64-99c0883e5820', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03a06109-aa90-41dc-b862-ea8084f0564d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:30 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume volume-dc14991e-ffd1-4db2-ab64-99c0883e5820 (dc14991e-ffd1-4db2-ab64-99c0883e5820): created successfully
Sep 10 12:05:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03a06109-aa90-41dc-b862-ea8084f0564d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:30 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Flow 'volume_create_manager' (f73ed9bc-412c-4cc2-bc90-c88b2d30050e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:05:30 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-7470d05e-3c28-46f9-be3e-dbb27288e6c9 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Created volume successfully.
Sep 10 12:05:31 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-31a0813a-df35-418c-8340-088318df8444 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "cinder-dc14991e-ffd1-4db2-ab64-99c0883e5820-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:31 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-31a0813a-df35-418c-8340-088318df8444 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "cinder-dc14991e-ffd1-4db2-ab64-99c0883e5820-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:31 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-31a0813a-df35-418c-8340-088318df8444 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:05:31 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-31a0813a-df35-418c-8340-088318df8444 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "cinder-quobyte-dc14991e-ffd1-4db2-ab64-99c0883e5820" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:31 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-31a0813a-df35-418c-8340-088318df8444 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "cinder-quobyte-dc14991e-ffd1-4db2-ab64-99c0883e5820" acquired by "delete_volume" :: waited 0.015s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:31 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b71c28-373c-43b3-8fc0-44aa0236386e]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:05:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-31a0813a-df35-418c-8340-088318df8444 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-dc14991e-ffd1-4db2-ab64-99c0883e5820 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-31a0813a-df35-418c-8340-088318df8444 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-dc14991e-ffd1-4db2-ab64-99c0883e5820" returned: 0 in 0.491s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-31a0813a-df35-418c-8340-088318df8444 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-dc14991e-ffd1-4db2-ab64-99c0883e5820 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-31a0813a-df35-418c-8340-088318df8444 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-dc14991e-ffd1-4db2-ab64-99c0883e5820" returned: 0 in 0.179s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:32 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-31a0813a-df35-418c-8340-088318df8444 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "cinder-quobyte-dc14991e-ffd1-4db2-ab64-99c0883e5820" released by "delete_volume" :: held 0.783s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:32 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-31a0813a-df35-418c-8340-088318df8444 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Created reservations ['cf122c53-aa12-4299-93fd-609e809344a0', '4d6f7af2-5fe9-4460-9aca-c76815edd729', '0d7dc82f-3364-4534-b804-6cfc30000b8e', '51093eab-aaa1-4a6e-96bc-9d3a6ad8d164'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:05:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-31a0813a-df35-418c-8340-088318df8444 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:05:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-31a0813a-df35-418c-8340-088318df8444 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:05:32 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-31a0813a-df35-418c-8340-088318df8444 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:05:32 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-31a0813a-df35-418c-8340-088318df8444 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:05:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-31a0813a-df35-418c-8340-088318df8444 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:05:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-31a0813a-df35-418c-8340-088318df8444 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-31a0813a-df35-418c-8340-088318df8444 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.104s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:32 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-31a0813a-df35-418c-8340-088318df8444 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:05:32 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-31a0813a-df35-418c-8340-088318df8444 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Deleted volume successfully.
Sep 10 12:05:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-31a0813a-df35-418c-8340-088318df8444 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "cinder-dc14991e-ffd1-4db2-ab64-99c0883e5820-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ff6f30ce-2dd2-43d1-8c8f-f807ec906c16 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "cinder-52ab40a4-bff3-4584-880a-51c8703f750f-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ff6f30ce-2dd2-43d1-8c8f-f807ec906c16 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "cinder-52ab40a4-bff3-4584-880a-51c8703f750f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:33 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-ff6f30ce-2dd2-43d1-8c8f-f807ec906c16 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:05:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ff6f30ce-2dd2-43d1-8c8f-f807ec906c16 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "cinder-quobyte-52ab40a4-bff3-4584-880a-51c8703f750f" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ff6f30ce-2dd2-43d1-8c8f-f807ec906c16 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "cinder-quobyte-52ab40a4-bff3-4584-880a-51c8703f750f" acquired by "delete_volume" :: waited 0.027s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:33 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdd45e8-cdcd-43c3-a1b6-9e1046cd5e6a]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:05:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ff6f30ce-2dd2-43d1-8c8f-f807ec906c16 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-52ab40a4-bff3-4584-880a-51c8703f750f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ff6f30ce-2dd2-43d1-8c8f-f807ec906c16 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-52ab40a4-bff3-4584-880a-51c8703f750f" returned: 0 in 0.407s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ff6f30ce-2dd2-43d1-8c8f-f807ec906c16 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-52ab40a4-bff3-4584-880a-51c8703f750f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ff6f30ce-2dd2-43d1-8c8f-f807ec906c16 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-52ab40a4-bff3-4584-880a-51c8703f750f" returned: 0 in 0.094s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:34 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ff6f30ce-2dd2-43d1-8c8f-f807ec906c16 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "cinder-quobyte-52ab40a4-bff3-4584-880a-51c8703f750f" released by "delete_volume" :: held 0.678s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:34 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-ff6f30ce-2dd2-43d1-8c8f-f807ec906c16 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Created reservations ['80bea8dc-c731-4838-b547-0dffb842bf79', '1b30725e-0f74-4841-9a97-9f1fbea4aaeb', '8edfb453-c3be-4114-914d-4d79d5ef9a6f', 'f95188ea-a114-4013-8847-d2ea11cf9248'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:05:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ff6f30ce-2dd2-43d1-8c8f-f807ec906c16 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:05:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ff6f30ce-2dd2-43d1-8c8f-f807ec906c16 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:05:34 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ff6f30ce-2dd2-43d1-8c8f-f807ec906c16 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:05:34 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ff6f30ce-2dd2-43d1-8c8f-f807ec906c16 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:05:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ff6f30ce-2dd2-43d1-8c8f-f807ec906c16 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:05:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ff6f30ce-2dd2-43d1-8c8f-f807ec906c16 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ff6f30ce-2dd2-43d1-8c8f-f807ec906c16 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.092s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:34 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-ff6f30ce-2dd2-43d1-8c8f-f807ec906c16 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:05:35 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-ff6f30ce-2dd2-43d1-8c8f-f807ec906c16 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Deleted volume successfully.
Sep 10 12:05:35 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ff6f30ce-2dd2-43d1-8c8f-f807ec906c16 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "cinder-52ab40a4-bff3-4584-880a-51c8703f750f-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:35 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9d03201b-942c-4d6c-a828-94c30b8c84bc tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "cinder-d937947c-28f7-4fd7-8f1f-6101d8031722-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:35 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9d03201b-942c-4d6c-a828-94c30b8c84bc tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "cinder-d937947c-28f7-4fd7-8f1f-6101d8031722-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:36 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-9d03201b-942c-4d6c-a828-94c30b8c84bc tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:05:36 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9d03201b-942c-4d6c-a828-94c30b8c84bc tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "cinder-quobyte-d937947c-28f7-4fd7-8f1f-6101d8031722" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:36 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9d03201b-942c-4d6c-a828-94c30b8c84bc tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "cinder-quobyte-d937947c-28f7-4fd7-8f1f-6101d8031722" acquired by "delete_volume" :: waited 0.017s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:36 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccbc512-fd1d-4d9b-9a48-94f4f5c34e40]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:05:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9d03201b-942c-4d6c-a828-94c30b8c84bc tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-d937947c-28f7-4fd7-8f1f-6101d8031722 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9d03201b-942c-4d6c-a828-94c30b8c84bc tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-d937947c-28f7-4fd7-8f1f-6101d8031722" returned: 0 in 0.425s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9d03201b-942c-4d6c-a828-94c30b8c84bc tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-d937947c-28f7-4fd7-8f1f-6101d8031722 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9d03201b-942c-4d6c-a828-94c30b8c84bc tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-d937947c-28f7-4fd7-8f1f-6101d8031722" returned: 0 in 0.102s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:36 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9d03201b-942c-4d6c-a828-94c30b8c84bc tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "cinder-quobyte-d937947c-28f7-4fd7-8f1f-6101d8031722" released by "delete_volume" :: held 0.701s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:37 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-9d03201b-942c-4d6c-a828-94c30b8c84bc tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Created reservations ['3c33b3cf-edba-49ff-b3ef-2b58815359d9', '08794227-204a-4526-ad43-35f0d594e7c2', '0d619eb3-420d-469a-a600-94efe68bb315', 'ded03256-dba0-4448-ac5c-f040900ea5d8'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:05:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9d03201b-942c-4d6c-a828-94c30b8c84bc tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:05:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9d03201b-942c-4d6c-a828-94c30b8c84bc tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:05:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9d03201b-942c-4d6c-a828-94c30b8c84bc tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:05:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-9d03201b-942c-4d6c-a828-94c30b8c84bc tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:05:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-9d03201b-942c-4d6c-a828-94c30b8c84bc tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:05:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9d03201b-942c-4d6c-a828-94c30b8c84bc tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-9d03201b-942c-4d6c-a828-94c30b8c84bc tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.095s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:37 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-9d03201b-942c-4d6c-a828-94c30b8c84bc tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:05:37 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-9d03201b-942c-4d6c-a828-94c30b8c84bc tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Deleted volume successfully.
Sep 10 12:05:37 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-9d03201b-942c-4d6c-a828-94c30b8c84bc tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "cinder-d937947c-28f7-4fd7-8f1f-6101d8031722-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:38 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-80f83997-2490-4183-b571-c27637132f39 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "cinder-beb37228-8a04-44f5-8941-ee6dbae27836-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:38 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-80f83997-2490-4183-b571-c27637132f39 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "cinder-beb37228-8a04-44f5-8941-ee6dbae27836-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:38 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-80f83997-2490-4183-b571-c27637132f39 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:05:38 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-80f83997-2490-4183-b571-c27637132f39 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "cinder-quobyte-beb37228-8a04-44f5-8941-ee6dbae27836" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:38 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-80f83997-2490-4183-b571-c27637132f39 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "cinder-quobyte-beb37228-8a04-44f5-8941-ee6dbae27836" acquired by "delete_volume" :: waited 0.018s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:38 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ed925e-16f4-46a1-8ee9-3dabd35ff4b2]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:05:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-80f83997-2490-4183-b571-c27637132f39 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-beb37228-8a04-44f5-8941-ee6dbae27836 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-80f83997-2490-4183-b571-c27637132f39 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-beb37228-8a04-44f5-8941-ee6dbae27836" returned: 0 in 0.406s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-80f83997-2490-4183-b571-c27637132f39 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-beb37228-8a04-44f5-8941-ee6dbae27836 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-80f83997-2490-4183-b571-c27637132f39 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-beb37228-8a04-44f5-8941-ee6dbae27836" returned: 0 in 0.101s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:39 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-80f83997-2490-4183-b571-c27637132f39 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "cinder-quobyte-beb37228-8a04-44f5-8941-ee6dbae27836" released by "delete_volume" :: held 0.673s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:39 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-80f83997-2490-4183-b571-c27637132f39 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Created reservations ['926a3221-c045-4079-a8af-9f21f23af1fd', '7adb5b92-e342-429e-9c77-9e6944cce12b', '61ca21cf-f6bf-4810-bf3c-b007f204c06e', 'db1c16e8-8aef-4fba-ad29-4e4b6d2073a6'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:05:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-80f83997-2490-4183-b571-c27637132f39 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:05:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-80f83997-2490-4183-b571-c27637132f39 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:05:39 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-80f83997-2490-4183-b571-c27637132f39 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:05:39 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-80f83997-2490-4183-b571-c27637132f39 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:05:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-80f83997-2490-4183-b571-c27637132f39 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:05:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-80f83997-2490-4183-b571-c27637132f39 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-80f83997-2490-4183-b571-c27637132f39 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.091s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:39 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-80f83997-2490-4183-b571-c27637132f39 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:05:39 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-80f83997-2490-4183-b571-c27637132f39 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Deleted volume successfully.
Sep 10 12:05:40 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-80f83997-2490-4183-b571-c27637132f39 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "cinder-beb37228-8a04-44f5-8941-ee6dbae27836-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:40 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f548ceaa-5cba-4101-bda1-61d5e891e8b4 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "cinder-4d5d8757-a942-4388-9468-0768e63374c9-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:40 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f548ceaa-5cba-4101-bda1-61d5e891e8b4 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "cinder-4d5d8757-a942-4388-9468-0768e63374c9-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:40 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=109,cinder:SELECT=71,cinder:DELETE=13,cinder:INSERT=22 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 12:05:40 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-f548ceaa-5cba-4101-bda1-61d5e891e8b4 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:05:40 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f548ceaa-5cba-4101-bda1-61d5e891e8b4 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "cinder-quobyte-4d5d8757-a942-4388-9468-0768e63374c9" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:40 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f548ceaa-5cba-4101-bda1-61d5e891e8b4 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "cinder-quobyte-4d5d8757-a942-4388-9468-0768e63374c9" acquired by "delete_volume" :: waited 0.015s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:40 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[79993d0f-43f0-47da-8bb7-b30b7280757b]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:05:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f548ceaa-5cba-4101-bda1-61d5e891e8b4 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4d5d8757-a942-4388-9468-0768e63374c9 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f548ceaa-5cba-4101-bda1-61d5e891e8b4 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4d5d8757-a942-4388-9468-0768e63374c9" returned: 0 in 0.437s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f548ceaa-5cba-4101-bda1-61d5e891e8b4 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4d5d8757-a942-4388-9468-0768e63374c9 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f548ceaa-5cba-4101-bda1-61d5e891e8b4 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-4d5d8757-a942-4388-9468-0768e63374c9" returned: 0 in 0.090s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:41 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f548ceaa-5cba-4101-bda1-61d5e891e8b4 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "cinder-quobyte-4d5d8757-a942-4388-9468-0768e63374c9" released by "delete_volume" :: held 0.699s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:41 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=68,cinder:UPDATE=113,cinder:DELETE=10,cinder:INSERT=22 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 12:05:42 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-f548ceaa-5cba-4101-bda1-61d5e891e8b4 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Created reservations ['25d5b109-ee54-4097-bc2b-11ef0f7b4e31', '40d8dd96-cdcd-418c-9ebd-872ac41d24f9', '5351ef01-bbce-48cf-9c57-e24fb8784a83', '3e270144-64c5-46cc-8519-1e7353108a58'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:05:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f548ceaa-5cba-4101-bda1-61d5e891e8b4 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:05:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f548ceaa-5cba-4101-bda1-61d5e891e8b4 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:05:42 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f548ceaa-5cba-4101-bda1-61d5e891e8b4 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:05:42 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f548ceaa-5cba-4101-bda1-61d5e891e8b4 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:05:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f548ceaa-5cba-4101-bda1-61d5e891e8b4 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:05:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f548ceaa-5cba-4101-bda1-61d5e891e8b4 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f548ceaa-5cba-4101-bda1-61d5e891e8b4 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.094s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:42 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-f548ceaa-5cba-4101-bda1-61d5e891e8b4 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:05:42 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-f548ceaa-5cba-4101-bda1-61d5e891e8b4 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Deleted volume successfully.
Sep 10 12:05:42 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f548ceaa-5cba-4101-bda1-61d5e891e8b4 tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "cinder-4d5d8757-a942-4388-9468-0768e63374c9-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:43 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fadec427-aa28-40eb-be01-3492d9b3c80c tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "cinder-9c776b48-923e-4df0-bc26-7bb477ab3781-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:43 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fadec427-aa28-40eb-be01-3492d9b3c80c tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "cinder-9c776b48-923e-4df0-bc26-7bb477ab3781-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:43 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-fadec427-aa28-40eb-be01-3492d9b3c80c tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:05:43 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fadec427-aa28-40eb-be01-3492d9b3c80c tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "cinder-quobyte-9c776b48-923e-4df0-bc26-7bb477ab3781" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:05:43 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fadec427-aa28-40eb-be01-3492d9b3c80c tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "cinder-quobyte-9c776b48-923e-4df0-bc26-7bb477ab3781" acquired by "delete_volume" :: waited 0.013s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:05:43 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[455a5e3a-d5da-42e8-83f4-90aae59c4233]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:05:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fadec427-aa28-40eb-be01-3492d9b3c80c tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9c776b48-923e-4df0-bc26-7bb477ab3781 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fadec427-aa28-40eb-be01-3492d9b3c80c tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9c776b48-923e-4df0-bc26-7bb477ab3781" returned: 0 in 0.414s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fadec427-aa28-40eb-be01-3492d9b3c80c tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9c776b48-923e-4df0-bc26-7bb477ab3781 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fadec427-aa28-40eb-be01-3492d9b3c80c tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9c776b48-923e-4df0-bc26-7bb477ab3781" returned: 0 in 0.088s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:44 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fadec427-aa28-40eb-be01-3492d9b3c80c tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "cinder-quobyte-9c776b48-923e-4df0-bc26-7bb477ab3781" released by "delete_volume" :: held 0.656s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:44 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-fadec427-aa28-40eb-be01-3492d9b3c80c tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Created reservations ['bbadb0f2-afa4-4a07-b9f2-dca7e5eb2b8c', '886d0ca5-d84e-498a-b59d-ce7c83fe431a', '546e4997-d1f0-4588-a867-265ed3f7a0b7', '42333bc2-aecc-4e25-8038-ef6c2cd81047'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:05:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fadec427-aa28-40eb-be01-3492d9b3c80c tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:05:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fadec427-aa28-40eb-be01-3492d9b3c80c tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:05:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fadec427-aa28-40eb-be01-3492d9b3c80c tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:05:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fadec427-aa28-40eb-be01-3492d9b3c80c tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:05:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fadec427-aa28-40eb-be01-3492d9b3c80c tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:05:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fadec427-aa28-40eb-be01-3492d9b3c80c tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fadec427-aa28-40eb-be01-3492d9b3c80c tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.134s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:44 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-fadec427-aa28-40eb-be01-3492d9b3c80c tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:05:44 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-fadec427-aa28-40eb-be01-3492d9b3c80c tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Deleted volume successfully.
Sep 10 12:05:44 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fadec427-aa28-40eb-be01-3492d9b3c80c tempest-CreateVolumesFromSourceVolumeTest-1929083893 None] Lock "cinder-9c776b48-923e-4df0-bc26-7bb477ab3781-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:05:51 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:05:51 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:05:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Flow 'volume_create_manager' (bfa874e5-e149-4d5a-b4bd-dc505976592e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:05:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c93dc0-2315-4411-a3f2-9df521910173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c93dc0-2315-4411-a3f2-9df521910173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a822f5-f2bb-4882-a476-c9976d6d242b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cbac22b797540b89c9a61c267e7b741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:05:51Z,use_quota=True,user_id='5ce35363580340a28f7f55ebabe26e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd98585b-4cea-4ce9-86e9-56efa27dded9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd98585b-4cea-4ce9-86e9-56efa27dded9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b16766b9-6afa-43c4-8d61-800633dfbd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b16766b9-6afa-43c4-8d61-800633dfbd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c5a822f5-f2bb-4882-a476-c9976d6d242b', 'volume_name': 'volume-c5a822f5-f2bb-4882-a476-c9976d6d242b', 'volume_size': 1, 'image_id': '6321fc9d-672c-4a76-82b0-46b93beef750', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '93d2f7d1aef2258dac51b9ad36e897ba', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5cbac22b797540b89c9a61c267e7b741', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0b2a13ac44b50b0af33f6186646428385de78f97423cb0f096ebcc8467edcf81382ad7fc6d429b62038ddf2ebdeb71980b9bfc0d9607234ec0343b2b9b562ea1', 'id': '6321fc9d-672c-4a76-82b0-46b93beef750', 'created_at': datetime.datetime(2025, 9, 10, 10, 5, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 10, 5, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6321fc9d-672c-4a76-82b0-46b93beef750/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4f477033a0>}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88107f4f-8026-4d10-9ca3-88fea82de5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88107f4f-8026-4d10-9ca3-88fea82de5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:05:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf23901-26aa-49bd-b9b8-7654f05fda65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:05:51 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Volume c5a822f5-f2bb-4882-a476-c9976d6d242b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c5a822f5-f2bb-4882-a476-c9976d6d242b', 'volume_size': 1, 'image_id': '6321fc9d-672c-4a76-82b0-46b93beef750', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '93d2f7d1aef2258dac51b9ad36e897ba', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5cbac22b797540b89c9a61c267e7b741', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0b2a13ac44b50b0af33f6186646428385de78f97423cb0f096ebcc8467edcf81382ad7fc6d429b62038ddf2ebdeb71980b9bfc0d9607234ec0343b2b9b562ea1', 'id': '6321fc9d-672c-4a76-82b0-46b93beef750', 'created_at': datetime.datetime(2025, 9, 10, 10, 5, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 10, 5, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6321fc9d-672c-4a76-82b0-46b93beef750/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4f477033a0>}
Sep 10 12:05:51 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Cloning c5a822f5-f2bb-4882-a476-c9976d6d242b from image 6321fc9d-672c-4a76-82b0-46b93beef750  at location (None, None). {{(pid=82594) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 12:05:51 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6321fc9d-672c-4a76-82b0-46b93beef750_gu1e6uufdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=82594) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 12:05:51 devstack cinder-volume[82594]: INFO cinder.image.image_utils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Image download 0.00 MB at 0.00 MB/s
Sep 10 12:05:51 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93262c2-8fd6-48e2-bbd6-c1da6186f3a1]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:05:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6321fc9d-672c-4a76-82b0-46b93beef750_gu1e6uufdevstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:52 devstack sudo[99316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6321fc9d-672c-4a76-82b0-46b93beef750_gu1e6uufdevstack@QuobyteHD
Sep 10 12:05:52 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 12:05:54 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root
Sep 10 12:05:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6321fc9d-672c-4a76-82b0-46b93beef750_gu1e6uufdevstack@QuobyteHD" returned: 0 in 2.102s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6321fc9d-672c-4a76-82b0-46b93beef750_gu1e6uufdevstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:54 devstack sudo[99320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6321fc9d-672c-4a76-82b0-46b93beef750_gu1e6uufdevstack@QuobyteHD
Sep 10 12:05:54 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 12:05:56 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root
Sep 10 12:05:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6321fc9d-672c-4a76-82b0-46b93beef750_gu1e6uufdevstack@QuobyteHD" returned: 1 in 2.035s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6321fc9d-672c-4a76-82b0-46b93beef750_gu1e6uufdevstack@QuobyteHD' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 12:05:56 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Temporary image 6321fc9d-672c-4a76-82b0-46b93beef750 is fetched for user 5ce35363580340a28f7f55ebabe26e6d. {{(pid=82594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 12:05:56 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[621d6f4c-3d0a-4902-9708-755d2f0b3414]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:05:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6321fc9d-672c-4a76-82b0-46b93beef750_gu1e6uufdevstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:56 devstack sudo[99325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6321fc9d-672c-4a76-82b0-46b93beef750_gu1e6uufdevstack@QuobyteHD
Sep 10 12:05:56 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 12:05:58 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root
Sep 10 12:05:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6321fc9d-672c-4a76-82b0-46b93beef750_gu1e6uufdevstack@QuobyteHD" returned: 0 in 1.960s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:05:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6321fc9d-672c-4a76-82b0-46b93beef750_gu1e6uufdevstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:05:58 devstack sudo[99329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6321fc9d-672c-4a76-82b0-46b93beef750_gu1e6uufdevstack@QuobyteHD
Sep 10 12:05:58 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 12:06:00 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root
Sep 10 12:06:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6321fc9d-672c-4a76-82b0-46b93beef750_gu1e6uufdevstack@QuobyteHD" returned: 1 in 2.038s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6321fc9d-672c-4a76-82b0-46b93beef750_gu1e6uufdevstack@QuobyteHD' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 12:06:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:06:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:06:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a822f5-f2bb-4882-a476-c9976d6d242b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cbac22b797540b89c9a61c267e7b741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:05:51Z,use_quota=True,user_id='5ce35363580340a28f7f55ebabe26e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:06:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Creating volume c5a822f5-f2bb-4882-a476-c9976d6d242b {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:06:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:06:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:06:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:06:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:06:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:06:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:06:00 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:06:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c5a822f5-f2bb-4882-a476-c9976d6d242b 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:00 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=141, name=volume-c5a822f5-f2bb-4882-a476-c9976d6d242b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:06:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c5a822f5-f2bb-4882-a476-c9976d6d242b 1073741824" returned: 0 in 0.340s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c5a822f5-f2bb-4882-a476-c9976d6d242b {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c5a822f5-f2bb-4882-a476-c9976d6d242b" returned: 0 in 0.098s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:01 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] <== create_volume: return (534ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:06:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.567s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:06:01 devstack cinder-volume[82594]: DEBUG cinder.volume.volume_utils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Attempting download of 6321fc9d-672c-4a76-82b0-46b93beef750 ((None, None)) to volume c5a822f5-f2bb-4882-a476-c9976d6d242b. {{(pid=82594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 12:06:01 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5584963-54cf-4fbd-b0cc-98ecd391e332]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:06:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6321fc9d-672c-4a76-82b0-46b93beef750_cwxn0f69 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6321fc9d-672c-4a76-82b0-46b93beef750_cwxn0f69" returned: 0 in 0.379s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6321fc9d-672c-4a76-82b0-46b93beef750_cwxn0f69 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6321fc9d-672c-4a76-82b0-46b93beef750_cwxn0f69" returned: 1 in 0.392s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6321fc9d-672c-4a76-82b0-46b93beef750_cwxn0f69' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 12:06:02 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e907be-ab2e-48b9-8b9a-20e9093b4462]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:06:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6321fc9d-672c-4a76-82b0-46b93beef750_gu1e6uufdevstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6321fc9d-672c-4a76-82b0-46b93beef750_gu1e6uufdevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6321fc9d-672c-4a76-82b0-46b93beef750_gu1e6uufdevstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6321fc9d-672c-4a76-82b0-46b93beef750_gu1e6uufdevstack@QuobyteHD" returned: 1 in 0.377s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6321fc9d-672c-4a76-82b0-46b93beef750_gu1e6uufdevstack@QuobyteHD' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 12:06:03 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] 6321fc9d-672c-4a76-82b0-46b93beef750 was raw, converting to raw {{(pid=82594) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 12:06:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6321fc9d-672c-4a76-82b0-46b93beef750_gu1e6uufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c5a822f5-f2bb-4882-a476-c9976d6d242b {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:03 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=141, name=volume-c5a822f5-f2bb-4882-a476-c9976d6d242b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:06:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6321fc9d-672c-4a76-82b0-46b93beef750_gu1e6uufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c5a822f5-f2bb-4882-a476-c9976d6d242b" returned: 0 in 0.165s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:03 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6321fc9d-672c-4a76-82b0-46b93beef750_gu1e6uufdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c5a822f5-f2bb-4882-a476-c9976d6d242b {{(pid=82594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 12:06:03 devstack cinder-volume[82594]: INFO cinder.image.image_utils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Converted 0.00 MB image at 0.00 MB/s
Sep 10 12:06:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c5a822f5-f2bb-4882-a476-c9976d6d242b 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c5a822f5-f2bb-4882-a476-c9976d6d242b 1G" returned: 0 in 0.126s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:03 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[40976146-095c-4390-9ae3-ec92fe3a19ca]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:06:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c5a822f5-f2bb-4882-a476-c9976d6d242b {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c5a822f5-f2bb-4882-a476-c9976d6d242b" returned: 0 in 0.359s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c5a822f5-f2bb-4882-a476-c9976d6d242b {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c5a822f5-f2bb-4882-a476-c9976d6d242b" returned: 1 in 0.376s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c5a822f5-f2bb-4882-a476-c9976d6d242b' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 12:06:04 devstack cinder-volume[82594]: DEBUG cinder.volume.volume_utils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Downloaded image 6321fc9d-672c-4a76-82b0-46b93beef750 ((None, None)) to volume c5a822f5-f2bb-4882-a476-c9976d6d242b successfully. {{(pid=82594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 12:06:04 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Temporary image 6321fc9d-672c-4a76-82b0-46b93beef750 for user 5ce35363580340a28f7f55ebabe26e6d is deleted. {{(pid=82594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 12:06:04 devstack cinder-volume[82594]: DEBUG cinder.volume.volume_utils [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Marking volume c5a822f5-f2bb-4882-a476-c9976d6d242b as bootable. {{(pid=82594) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 12:06:04 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Copying metadata from image 6321fc9d-672c-4a76-82b0-46b93beef750 to c5a822f5-f2bb-4882-a476-c9976d6d242b. {{(pid=82594) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 12:06:04 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Creating volume glance metadata for volume c5a822f5-f2bb-4882-a476-c9976d6d242b backed by image 6321fc9d-672c-4a76-82b0-46b93beef750 with: {'image_id': '6321fc9d-672c-4a76-82b0-46b93beef750', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '93d2f7d1aef2258dac51b9ad36e897ba', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=82594) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 12:06:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf23901-26aa-49bd-b9b8-7654f05fda65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5a822f5-f2bb-4882-a476-c9976d6d242b', 'volume_size': 1, 'image_id': '6321fc9d-672c-4a76-82b0-46b93beef750', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '93d2f7d1aef2258dac51b9ad36e897ba', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5cbac22b797540b89c9a61c267e7b741', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0b2a13ac44b50b0af33f6186646428385de78f97423cb0f096ebcc8467edcf81382ad7fc6d429b62038ddf2ebdeb71980b9bfc0d9607234ec0343b2b9b562ea1', 'id': '6321fc9d-672c-4a76-82b0-46b93beef750', 'created_at': datetime.datetime(2025, 9, 10, 10, 5, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 10, 5, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6321fc9d-672c-4a76-82b0-46b93beef750/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4f477033a0>}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:06:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176dbbbf-ca44-49d7-ac8e-3fbcc4973bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:06:04 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Volume volume-c5a822f5-f2bb-4882-a476-c9976d6d242b (c5a822f5-f2bb-4882-a476-c9976d6d242b): created successfully
Sep 10 12:06:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176dbbbf-ca44-49d7-ac8e-3fbcc4973bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:06:04 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Flow 'volume_create_manager' (bfa874e5-e149-4d5a-b4bd-dc505976592e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:06:04 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-15c8be51-475f-4b1d-af6b-5d9f57b26eae tempest-VolumeImageDependencyTests-58740569 None] Created volume successfully.
Sep 10 12:06:05 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-99b0cb6f-79dd-43a9-bb72-4ae9d7a6562a tempest-VolumeImageDependencyTests-58740569 None] Acquiring lock "cinder-c5a822f5-f2bb-4882-a476-c9976d6d242b-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:06:05 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-99b0cb6f-79dd-43a9-bb72-4ae9d7a6562a tempest-VolumeImageDependencyTests-58740569 None] Lock "cinder-c5a822f5-f2bb-4882-a476-c9976d6d242b-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:06:05 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-99b0cb6f-79dd-43a9-bb72-4ae9d7a6562a tempest-VolumeImageDependencyTests-58740569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:06:05 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-99b0cb6f-79dd-43a9-bb72-4ae9d7a6562a tempest-VolumeImageDependencyTests-58740569 None] Acquiring lock "cinder-quobyte-c5a822f5-f2bb-4882-a476-c9976d6d242b" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:06:05 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-99b0cb6f-79dd-43a9-bb72-4ae9d7a6562a tempest-VolumeImageDependencyTests-58740569 None] Lock "cinder-quobyte-c5a822f5-f2bb-4882-a476-c9976d6d242b" acquired by "delete_volume" :: waited 0.014s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:06:05 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c473a9-955d-48a1-aa3f-4edfd40f56d1]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:06:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-99b0cb6f-79dd-43a9-bb72-4ae9d7a6562a tempest-VolumeImageDependencyTests-58740569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c5a822f5-f2bb-4882-a476-c9976d6d242b {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-99b0cb6f-79dd-43a9-bb72-4ae9d7a6562a tempest-VolumeImageDependencyTests-58740569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c5a822f5-f2bb-4882-a476-c9976d6d242b" returned: 0 in 0.557s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-99b0cb6f-79dd-43a9-bb72-4ae9d7a6562a tempest-VolumeImageDependencyTests-58740569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c5a822f5-f2bb-4882-a476-c9976d6d242b {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-99b0cb6f-79dd-43a9-bb72-4ae9d7a6562a tempest-VolumeImageDependencyTests-58740569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c5a822f5-f2bb-4882-a476-c9976d6d242b" returned: 1 in 0.436s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-99b0cb6f-79dd-43a9-bb72-4ae9d7a6562a tempest-VolumeImageDependencyTests-58740569 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c5a822f5-f2bb-4882-a476-c9976d6d242b' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 12:06:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-99b0cb6f-79dd-43a9-bb72-4ae9d7a6562a tempest-VolumeImageDependencyTests-58740569 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c5a822f5-f2bb-4882-a476-c9976d6d242b {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-99b0cb6f-79dd-43a9-bb72-4ae9d7a6562a tempest-VolumeImageDependencyTests-58740569 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c5a822f5-f2bb-4882-a476-c9976d6d242b" returned: 0 in 0.083s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:06 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-99b0cb6f-79dd-43a9-bb72-4ae9d7a6562a tempest-VolumeImageDependencyTests-58740569 None] Lock "cinder-quobyte-c5a822f5-f2bb-4882-a476-c9976d6d242b" released by "delete_volume" :: held 1.291s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:06:07 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-99b0cb6f-79dd-43a9-bb72-4ae9d7a6562a tempest-VolumeImageDependencyTests-58740569 None] Created reservations ['318c5cfe-de81-4649-9bba-f2cfc225713e', 'a1570519-14e4-47b0-a465-26affe02864a', 'deaadd42-355d-4b8d-b6de-bac3b970d3d0', 'ae7434a7-77ef-43c8-8467-567c52942db1'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:06:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-99b0cb6f-79dd-43a9-bb72-4ae9d7a6562a tempest-VolumeImageDependencyTests-58740569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:06:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-99b0cb6f-79dd-43a9-bb72-4ae9d7a6562a tempest-VolumeImageDependencyTests-58740569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:06:07 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-99b0cb6f-79dd-43a9-bb72-4ae9d7a6562a tempest-VolumeImageDependencyTests-58740569 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:06:07 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-99b0cb6f-79dd-43a9-bb72-4ae9d7a6562a tempest-VolumeImageDependencyTests-58740569 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:06:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-99b0cb6f-79dd-43a9-bb72-4ae9d7a6562a tempest-VolumeImageDependencyTests-58740569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:06:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-99b0cb6f-79dd-43a9-bb72-4ae9d7a6562a tempest-VolumeImageDependencyTests-58740569 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-99b0cb6f-79dd-43a9-bb72-4ae9d7a6562a tempest-VolumeImageDependencyTests-58740569 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.096s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:07 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-99b0cb6f-79dd-43a9-bb72-4ae9d7a6562a tempest-VolumeImageDependencyTests-58740569 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:06:07 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-99b0cb6f-79dd-43a9-bb72-4ae9d7a6562a tempest-VolumeImageDependencyTests-58740569 None] Deleted volume successfully.
Sep 10 12:06:07 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-99b0cb6f-79dd-43a9-bb72-4ae9d7a6562a tempest-VolumeImageDependencyTests-58740569 None] Lock "cinder-c5a822f5-f2bb-4882-a476-c9976d6d242b-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:06:17 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=30,cinder:INSERT=17,cinder:UPDATE=25,cinder:DELETE=2 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 12:06:17 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=30,cinder:SELECT=11,cinder:INSERT=4,cinder:DELETE=2 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 12:06:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 12:06:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:06:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:06:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:06:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:06:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:06:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.132s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:23 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:06:40 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Flow 'volume_create_manager' (e619123c-2da4-4dcf-aae1-bfdb9f585368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1c4bf36-1a80-49fe-a54a-a06681557293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1c4bf36-1a80-49fe-a54a-a06681557293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1433372798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56170661-f836-4596-9708-6c26d1ebcd4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7d15a895f04df4a388ee8661a8cf3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:06:40Z,use_quota=True,user_id='d45643e42e6d45678435777bdd3d2275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c6481c-85d2-47b4-85d7-0a29220c7c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c6481c-85d2-47b4-85d7-0a29220c7c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a434a9-328f-4408-a8da-ad1c85ccd9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a434a9-328f-4408-a8da-ad1c85ccd9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56170661-f836-4596-9708-6c26d1ebcd4c', 'volume_name': 'volume-56170661-f836-4596-9708-6c26d1ebcd4c', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb630805-b115-419f-84bb-557d2ffed10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb630805-b115-419f-84bb-557d2ffed10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f6154f-9494-4a04-a1a3-338d02bdbc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:06:40 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Volume 56170661-f836-4596-9708-6c26d1ebcd4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56170661-f836-4596-9708-6c26d1ebcd4c', 'volume_size': 1}
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1433372798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56170661-f836-4596-9708-6c26d1ebcd4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7d15a895f04df4a388ee8661a8cf3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:06:40Z,use_quota=True,user_id='d45643e42e6d45678435777bdd3d2275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Creating volume 56170661-f836-4596-9708-6c26d1ebcd4c {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:06:40 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:40 devstack quobyte-client[82616]: System call of process 99411 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:06:40 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=142, name=volume-56170661-f836-4596-9708-6c26d1ebcd4c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c 1073741824" returned: 0 in 0.366s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c" returned: 0 in 0.087s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] <== create_volume: return (539ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:06:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.549s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:06:41 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f6154f-9494-4a04-a1a3-338d02bdbc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56170661-f836-4596-9708-6c26d1ebcd4c', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:06:41 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d7c3b4c-ddaf-4107-8652-5dd51ae6e8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:06:41 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Volume volume-56170661-f836-4596-9708-6c26d1ebcd4c (56170661-f836-4596-9708-6c26d1ebcd4c): created successfully
Sep 10 12:06:41 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d7c3b4c-ddaf-4107-8652-5dd51ae6e8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:06:41 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Flow 'volume_create_manager' (e619123c-2da4-4dcf-aae1-bfdb9f585368) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:06:41 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-6ae495f9-5b3f-449e-ba3e-9f6b23c84ac4 tempest-SnapshotDependencyTests-1702750631 None] Created volume successfully.
Sep 10 12:06:42 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-b72de9ae-fb7a-4562-a52a-ee410a438788 tempest-SnapshotDependencyTests-1702750631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:06:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b72de9ae-fb7a-4562-a52a-ee410a438788 tempest-SnapshotDependencyTests-1702750631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:06:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b72de9ae-fb7a-4562-a52a-ee410a438788 tempest-SnapshotDependencyTests-1702750631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:06:42 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-b72de9ae-fb7a-4562-a52a-ee410a438788 tempest-SnapshotDependencyTests-1702750631 None] Creating offline snapshot c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23 of volume 56170661-f836-4596-9708-6c26d1ebcd4c {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 12:06:42 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[74056eb4-99f0-4ff4-8411-10d9f946dffd]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:06:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b72de9ae-fb7a-4562-a52a-ee410a438788 tempest-SnapshotDependencyTests-1702750631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b72de9ae-fb7a-4562-a52a-ee410a438788 tempest-SnapshotDependencyTests-1702750631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c" returned: 0 in 0.458s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b72de9ae-fb7a-4562-a52a-ee410a438788 tempest-SnapshotDependencyTests-1702750631 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c.c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:43 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=143, name=volume-56170661-f836-4596-9708-6c26d1ebcd4c.c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:06:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b72de9ae-fb7a-4562-a52a-ee410a438788 tempest-SnapshotDependencyTests-1702750631 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c.c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23 1G" returned: 0 in 0.248s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b72de9ae-fb7a-4562-a52a-ee410a438788 tempest-SnapshotDependencyTests-1702750631 None] Running cmd (subprocess): qemu-img rebase -u -b volume-56170661-f836-4596-9708-6c26d1ebcd4c -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c.c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b72de9ae-fb7a-4562-a52a-ee410a438788 tempest-SnapshotDependencyTests-1702750631 None] CMD "qemu-img rebase -u -b volume-56170661-f836-4596-9708-6c26d1ebcd4c -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c.c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23" returned: 0 in 0.150s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:43 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-b72de9ae-fb7a-4562-a52a-ee410a438788 tempest-SnapshotDependencyTests-1702750631 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c.c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23 is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 12:06:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b72de9ae-fb7a-4562-a52a-ee410a438788 tempest-SnapshotDependencyTests-1702750631 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c.c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b72de9ae-fb7a-4562-a52a-ee410a438788 tempest-SnapshotDependencyTests-1702750631 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c.c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23" returned: 0 in 0.139s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:43 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-b72de9ae-fb7a-4562-a52a-ee410a438788 tempest-SnapshotDependencyTests-1702750631 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 12:06:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b72de9ae-fb7a-4562-a52a-ee410a438788 tempest-SnapshotDependencyTests-1702750631 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c.c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b72de9ae-fb7a-4562-a52a-ee410a438788 tempest-SnapshotDependencyTests-1702750631 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c.c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23" returned: 0 in 0.085s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b72de9ae-fb7a-4562-a52a-ee410a438788 tempest-SnapshotDependencyTests-1702750631 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b72de9ae-fb7a-4562-a52a-ee410a438788 tempest-SnapshotDependencyTests-1702750631 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c.info" returned: 0 in 0.092s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:43 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-b72de9ae-fb7a-4562-a52a-ee410a438788 tempest-SnapshotDependencyTests-1702750631 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c.info is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 12:06:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b72de9ae-fb7a-4562-a52a-ee410a438788 tempest-SnapshotDependencyTests-1702750631 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b72de9ae-fb7a-4562-a52a-ee410a438788 tempest-SnapshotDependencyTests-1702750631 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c.info" returned: 0 in 0.085s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b72de9ae-fb7a-4562-a52a-ee410a438788 tempest-SnapshotDependencyTests-1702750631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.600s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:06:44 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-b72de9ae-fb7a-4562-a52a-ee410a438788 tempest-SnapshotDependencyTests-1702750631 None] Create snapshot completed successfully
Sep 10 12:06:45 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Flow 'volume_create_manager' (4438bb1d-c856-4dfc-b697-483706e5c8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (136b8044-8577-4099-bb37-c684f5cbd9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (136b8044-8577-4099-bb37-c684f5cbd9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bab3fac-0e22-433a-a4ac-e665c2f29575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7d15a895f04df4a388ee8661a8cf3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:06:45Z,use_quota=True,user_id='d45643e42e6d45678435777bdd3d2275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29446d2b-089f-4444-a511-3a1afc0b52bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29446d2b-089f-4444-a511-3a1afc0b52bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6f6524-712e-4059-9e50-4bc826a770ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6f6524-712e-4059-9e50-4bc826a770ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7bab3fac-0e22-433a-a4ac-e665c2f29575', 'volume_name': 'volume-7bab3fac-0e22-433a-a4ac-e665c2f29575', 'volume_size': 1, 'snapshot_id': 'c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23'}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3997760f-57c2-4691-b80e-5ab6e9a80d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3997760f-57c2-4691-b80e-5ab6e9a80d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f8fdb4-1ddd-42e2-aa92-ceae916f28b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:06:45 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Volume 7bab3fac-0e22-433a-a4ac-e665c2f29575: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7bab3fac-0e22-433a-a4ac-e665c2f29575', 'volume_size': 1, 'snapshot_id': 'c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23'}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Acquiring lock "cinder-quobyte-c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23-7bab3fac-0e22-433a-a4ac-e665c2f29575" by "_create_volume_from_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Lock "cinder-quobyte-c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23-7bab3fac-0e22-433a-a4ac-e665c2f29575" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Creating volume 7bab3fac-0e22-433a-a4ac-e665c2f29575 from snapshot c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23 {{(pid=82594) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Acquiring lock "cinder-quobyte-7bab3fac-0e22-433a-a4ac-e665c2f29575" by "_copy_volume_from_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Lock "cinder-quobyte-7bab3fac-0e22-433a-a4ac-e665c2f29575" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] snapshot: c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23, volume: 7bab3fac-0e22-433a-a4ac-e665c2f29575,  {{(pid=82594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eda43da-10d1-4997-af23-737c8927cf7b]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c.c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c.c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23" returned: 0 in 0.399s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56170661-f836-4596-9708-6c26d1ebcd4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c {{(pid=82594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Creating direct copy from snapshot {{(pid=82594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f74ccb-6e50-4bc7-b888-fbf482845ce5]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:06:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c" returned: 0 in 0.423s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:46 devstack cinder-volume[82594]: DEBUG cinder.utils [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7bab3fac-0e22-433a-a4ac-e665c2f29575 not found in is_blk_device check {{(pid=82594) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 10 12:06:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7bab3fac-0e22-433a-a4ac-e665c2f29575 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:46 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=145, name=volume-7bab3fac-0e22-433a-a4ac-e665c2f29575, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:06:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7bab3fac-0e22-433a-a4ac-e665c2f29575" returned: 0 in 6.973s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:53 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c6bb83-e000-441f-aca0-7a8c2d39cfa0]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:06:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c" returned: 0 in 0.554s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:53 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Image conversion details: src /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c, size 1024.00 MB, duration 7.00 sec, destination /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7bab3fac-0e22-433a-a4ac-e665c2f29575 {{(pid=82594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 12:06:53 devstack cinder-volume[82594]: INFO cinder.image.image_utils [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Converted 1024.00 MB image at 146.34 MB/s
Sep 10 12:06:53 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7bab3fac-0e22-433a-a4ac-e665c2f29575 is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 12:06:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7bab3fac-0e22-433a-a4ac-e665c2f29575 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7bab3fac-0e22-433a-a4ac-e665c2f29575" returned: 0 in 0.086s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:54 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Lock "cinder-quobyte-7bab3fac-0e22-433a-a4ac-e665c2f29575" released by "_copy_volume_from_snapshot" :: held 8.791s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:06:54 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Lock "cinder-quobyte-c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23-7bab3fac-0e22-433a-a4ac-e665c2f29575" released by "_create_volume_from_snapshot" :: held 8.834s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:06:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.860s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:06:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f8fdb4-1ddd-42e2-aa92-ceae916f28b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bab3fac-0e22-433a-a4ac-e665c2f29575', 'volume_size': 1, 'snapshot_id': 'c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23'}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:06:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e0b3f2d-f770-4f30-9397-54479c60b2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:06:54 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Volume volume-7bab3fac-0e22-433a-a4ac-e665c2f29575 (7bab3fac-0e22-433a-a4ac-e665c2f29575): created successfully
Sep 10 12:06:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e0b3f2d-f770-4f30-9397-54479c60b2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:06:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Flow 'volume_create_manager' (4438bb1d-c856-4dfc-b697-483706e5c8e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:06:54 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-2a6f5491-2a25-4f56-b6ab-cec2e9e57595 tempest-SnapshotDependencyTests-1702750631 None] Created volume successfully.
Sep 10 12:06:55 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-464ff367-e5de-49b9-8537-aede79e530da tempest-SnapshotDependencyTests-1702750631 None] Acquiring lock "cinder-c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23-delete_snapshot" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:06:55 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-464ff367-e5de-49b9-8537-aede79e530da tempest-SnapshotDependencyTests-1702750631 None] Lock "cinder-c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:06:55 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-464ff367-e5de-49b9-8537-aede79e530da tempest-SnapshotDependencyTests-1702750631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:06:55 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-464ff367-e5de-49b9-8537-aede79e530da tempest-SnapshotDependencyTests-1702750631 None] Acquiring lock "cinder-quobyte-56170661-f836-4596-9708-6c26d1ebcd4c" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:06:55 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-464ff367-e5de-49b9-8537-aede79e530da tempest-SnapshotDependencyTests-1702750631 None] Lock "cinder-quobyte-56170661-f836-4596-9708-6c26d1ebcd4c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:06:55 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-464ff367-e5de-49b9-8537-aede79e530da tempest-SnapshotDependencyTests-1702750631 None] Acquiring lock "cinder-quobyte-c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:06:55 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-464ff367-e5de-49b9-8537-aede79e530da tempest-SnapshotDependencyTests-1702750631 None] Lock "cinder-quobyte-c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:06:55 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-464ff367-e5de-49b9-8537-aede79e530da tempest-SnapshotDependencyTests-1702750631 None] Deleting offline snapshot c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23 of volume 56170661-f836-4596-9708-6c26d1ebcd4c {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 12:06:55 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-464ff367-e5de-49b9-8537-aede79e530da tempest-SnapshotDependencyTests-1702750631 None] snapshot_file for this snap is: volume-56170661-f836-4596-9708-6c26d1ebcd4c.c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 12:06:55 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5aa7db5-1daf-4c7b-bd6c-463ab69ced53]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:06:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-464ff367-e5de-49b9-8537-aede79e530da tempest-SnapshotDependencyTests-1702750631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c.c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-464ff367-e5de-49b9-8537-aede79e530da tempest-SnapshotDependencyTests-1702750631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c.c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23" returned: 0 in 0.373s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:56 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-464ff367-e5de-49b9-8537-aede79e530da tempest-SnapshotDependencyTests-1702750631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56170661-f836-4596-9708-6c26d1ebcd4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 12:06:56 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa378b48-8820-4956-9822-0c4137b17cfa]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:06:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-464ff367-e5de-49b9-8537-aede79e530da tempest-SnapshotDependencyTests-1702750631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-464ff367-e5de-49b9-8537-aede79e530da tempest-SnapshotDependencyTests-1702750631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c" returned: 0 in 0.418s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-464ff367-e5de-49b9-8537-aede79e530da tempest-SnapshotDependencyTests-1702750631 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c.c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-464ff367-e5de-49b9-8537-aede79e530da tempest-SnapshotDependencyTests-1702750631 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c.c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23" returned: 0 in 0.243s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-464ff367-e5de-49b9-8537-aede79e530da tempest-SnapshotDependencyTests-1702750631 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c.c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-464ff367-e5de-49b9-8537-aede79e530da tempest-SnapshotDependencyTests-1702750631 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c.c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23" returned: 0 in 0.094s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:57 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-464ff367-e5de-49b9-8537-aede79e530da tempest-SnapshotDependencyTests-1702750631 None] Lock "cinder-quobyte-c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23" released by "_delete_snapshot" :: held 1.388s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:06:57 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-464ff367-e5de-49b9-8537-aede79e530da tempest-SnapshotDependencyTests-1702750631 None] Lock "cinder-quobyte-56170661-f836-4596-9708-6c26d1ebcd4c" released by "delete_snapshot" :: held 1.410s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:06:57 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-464ff367-e5de-49b9-8537-aede79e530da tempest-SnapshotDependencyTests-1702750631 None] Created reservations ['5bb0f91d-379e-498a-a021-89bfcc7bbd2b', '8a346808-6bb6-4f94-8152-159182b238fc', '9901d28f-8584-4a08-a1de-b530cce8924f', 'a3bcab95-2d90-4c5e-8797-a9afaf7ca52a'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:06:57 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-464ff367-e5de-49b9-8537-aede79e530da tempest-SnapshotDependencyTests-1702750631 None] Delete snapshot completed successfully.
Sep 10 12:06:57 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-464ff367-e5de-49b9-8537-aede79e530da tempest-SnapshotDependencyTests-1702750631 None] Lock "cinder-c7d4b224-eadd-4f5b-b6c4-c1cff4c89e23-delete_snapshot" released by "delete_snapshot" :: held 1.858s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:06:58 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f0bcda75-526d-421e-8f74-de91e484a536 tempest-SnapshotDependencyTests-1702750631 None] Acquiring lock "cinder-56170661-f836-4596-9708-6c26d1ebcd4c-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:06:58 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f0bcda75-526d-421e-8f74-de91e484a536 tempest-SnapshotDependencyTests-1702750631 None] Lock "cinder-56170661-f836-4596-9708-6c26d1ebcd4c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:06:58 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-f0bcda75-526d-421e-8f74-de91e484a536 tempest-SnapshotDependencyTests-1702750631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:06:58 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f0bcda75-526d-421e-8f74-de91e484a536 tempest-SnapshotDependencyTests-1702750631 None] Acquiring lock "cinder-quobyte-56170661-f836-4596-9708-6c26d1ebcd4c" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:06:58 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f0bcda75-526d-421e-8f74-de91e484a536 tempest-SnapshotDependencyTests-1702750631 None] Lock "cinder-quobyte-56170661-f836-4596-9708-6c26d1ebcd4c" acquired by "delete_volume" :: waited 0.029s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:06:58 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7850f0-de39-4433-bb9c-6bc70309b919]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:06:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f0bcda75-526d-421e-8f74-de91e484a536 tempest-SnapshotDependencyTests-1702750631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f0bcda75-526d-421e-8f74-de91e484a536 tempest-SnapshotDependencyTests-1702750631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c" returned: 0 in 0.405s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f0bcda75-526d-421e-8f74-de91e484a536 tempest-SnapshotDependencyTests-1702750631 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f0bcda75-526d-421e-8f74-de91e484a536 tempest-SnapshotDependencyTests-1702750631 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-56170661-f836-4596-9708-6c26d1ebcd4c" returned: 0 in 0.086s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:58 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f0bcda75-526d-421e-8f74-de91e484a536 tempest-SnapshotDependencyTests-1702750631 None] Lock "cinder-quobyte-56170661-f836-4596-9708-6c26d1ebcd4c" released by "delete_volume" :: held 0.657s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:06:59 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-f0bcda75-526d-421e-8f74-de91e484a536 tempest-SnapshotDependencyTests-1702750631 None] Created reservations ['90cd8898-0c7b-4dfc-8ce2-42a9b271d2d7', '391df2b2-9874-4515-bd42-d433cedfc705', 'a48d4229-578d-4afa-be60-a955f642c89c', '9dfa36c9-308f-4714-a8e2-e7b2cf35bdaf'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:06:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f0bcda75-526d-421e-8f74-de91e484a536 tempest-SnapshotDependencyTests-1702750631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:06:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f0bcda75-526d-421e-8f74-de91e484a536 tempest-SnapshotDependencyTests-1702750631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:06:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f0bcda75-526d-421e-8f74-de91e484a536 tempest-SnapshotDependencyTests-1702750631 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:06:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f0bcda75-526d-421e-8f74-de91e484a536 tempest-SnapshotDependencyTests-1702750631 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:06:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f0bcda75-526d-421e-8f74-de91e484a536 tempest-SnapshotDependencyTests-1702750631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:06:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f0bcda75-526d-421e-8f74-de91e484a536 tempest-SnapshotDependencyTests-1702750631 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:06:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f0bcda75-526d-421e-8f74-de91e484a536 tempest-SnapshotDependencyTests-1702750631 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.085s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:06:59 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-f0bcda75-526d-421e-8f74-de91e484a536 tempest-SnapshotDependencyTests-1702750631 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:06:59 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-f0bcda75-526d-421e-8f74-de91e484a536 tempest-SnapshotDependencyTests-1702750631 None] Deleted volume successfully.
Sep 10 12:06:59 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f0bcda75-526d-421e-8f74-de91e484a536 tempest-SnapshotDependencyTests-1702750631 None] Lock "cinder-56170661-f836-4596-9708-6c26d1ebcd4c-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:07:00 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fd07221c-e6c5-4c8b-8a50-90f39178ef45 tempest-SnapshotDependencyTests-1702750631 None] Acquiring lock "cinder-7bab3fac-0e22-433a-a4ac-e665c2f29575-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:07:00 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fd07221c-e6c5-4c8b-8a50-90f39178ef45 tempest-SnapshotDependencyTests-1702750631 None] Lock "cinder-7bab3fac-0e22-433a-a4ac-e665c2f29575-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:07:00 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-fd07221c-e6c5-4c8b-8a50-90f39178ef45 tempest-SnapshotDependencyTests-1702750631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:07:00 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fd07221c-e6c5-4c8b-8a50-90f39178ef45 tempest-SnapshotDependencyTests-1702750631 None] Acquiring lock "cinder-quobyte-7bab3fac-0e22-433a-a4ac-e665c2f29575" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:07:00 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fd07221c-e6c5-4c8b-8a50-90f39178ef45 tempest-SnapshotDependencyTests-1702750631 None] Lock "cinder-quobyte-7bab3fac-0e22-433a-a4ac-e665c2f29575" acquired by "delete_volume" :: waited 0.014s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:07:00 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e597022-3794-4f32-819e-cc8138746779]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:07:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fd07221c-e6c5-4c8b-8a50-90f39178ef45 tempest-SnapshotDependencyTests-1702750631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7bab3fac-0e22-433a-a4ac-e665c2f29575 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fd07221c-e6c5-4c8b-8a50-90f39178ef45 tempest-SnapshotDependencyTests-1702750631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7bab3fac-0e22-433a-a4ac-e665c2f29575" returned: 0 in 0.391s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fd07221c-e6c5-4c8b-8a50-90f39178ef45 tempest-SnapshotDependencyTests-1702750631 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7bab3fac-0e22-433a-a4ac-e665c2f29575 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fd07221c-e6c5-4c8b-8a50-90f39178ef45 tempest-SnapshotDependencyTests-1702750631 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7bab3fac-0e22-433a-a4ac-e665c2f29575" returned: 0 in 0.089s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fd07221c-e6c5-4c8b-8a50-90f39178ef45 tempest-SnapshotDependencyTests-1702750631 None] Lock "cinder-quobyte-7bab3fac-0e22-433a-a4ac-e665c2f29575" released by "delete_volume" :: held 0.642s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:07:01 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-fd07221c-e6c5-4c8b-8a50-90f39178ef45 tempest-SnapshotDependencyTests-1702750631 None] Created reservations ['80a2e44d-96bc-4800-af83-4021de964880', '3a687e19-2275-47e8-9743-060d983f06d7', '043232ab-5549-499e-8345-40b447c0c585', 'c97bf8c8-1dc0-4205-9c2c-dedb8f96a5e0'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:07:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fd07221c-e6c5-4c8b-8a50-90f39178ef45 tempest-SnapshotDependencyTests-1702750631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:07:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fd07221c-e6c5-4c8b-8a50-90f39178ef45 tempest-SnapshotDependencyTests-1702750631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:07:01 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fd07221c-e6c5-4c8b-8a50-90f39178ef45 tempest-SnapshotDependencyTests-1702750631 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:07:01 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fd07221c-e6c5-4c8b-8a50-90f39178ef45 tempest-SnapshotDependencyTests-1702750631 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:07:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fd07221c-e6c5-4c8b-8a50-90f39178ef45 tempest-SnapshotDependencyTests-1702750631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:07:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fd07221c-e6c5-4c8b-8a50-90f39178ef45 tempest-SnapshotDependencyTests-1702750631 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fd07221c-e6c5-4c8b-8a50-90f39178ef45 tempest-SnapshotDependencyTests-1702750631 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.092s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:01 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-fd07221c-e6c5-4c8b-8a50-90f39178ef45 tempest-SnapshotDependencyTests-1702750631 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:07:01 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-fd07221c-e6c5-4c8b-8a50-90f39178ef45 tempest-SnapshotDependencyTests-1702750631 None] Deleted volume successfully.
Sep 10 12:07:02 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fd07221c-e6c5-4c8b-8a50-90f39178ef45 tempest-SnapshotDependencyTests-1702750631 None] Lock "cinder-7bab3fac-0e22-433a-a4ac-e665c2f29575-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:07:11 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=26,cinder:DELETE=1,cinder:SELECT=19,cinder:INSERT=6 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 12:07:11 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=20,cinder:UPDATE=27,cinder:DELETE=4,cinder:INSERT=6 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 12:07:22 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 12:07:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:07:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:07:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:07:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:07:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:07:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.114s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:23 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:07:37 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:07:37 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:07:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Flow 'volume_create_manager' (3cbd3833-c66e-4e8d-a796-397dfa633b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:07:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfc9a58-fe0d-45d9-91ad-a2665f7dd308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:37 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:07:37 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:07:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Flow 'volume_create_manager' (7839c5f2-eef6-44f0-aad4-d3d7aad32e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:07:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234ce072-46d4-45a8-8c48-c0bb4f086e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfc9a58-fe0d-45d9-91ad-a2665f7dd308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-481333753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc96a680-2831-437e-a322-e665ce3d3a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d05f30e9ff01438c8ad005b9f452468e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:07:37Z,use_quota=True,user_id='a1ad3849e1134c1e8fc7a24f0d696a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c68c40d9-f5d3-4aee-84a0-cbe2449106f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c68c40d9-f5d3-4aee-84a0-cbe2449106f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1463194f-fac1-40d5-a2f3-2ce2cb8f1a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1463194f-fac1-40d5-a2f3-2ce2cb8f1a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc96a680-2831-437e-a322-e665ce3d3a15', 'volume_name': 'volume-dc96a680-2831-437e-a322-e665ce3d3a15', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5edadbd-f2fb-4836-a93e-f080baf6d26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5edadbd-f2fb-4836-a93e-f080baf6d26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:37 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb6018a-c8ed-44d7-af4e-52718a436a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:37 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Volume dc96a680-2831-437e-a322-e665ce3d3a15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc96a680-2831-437e-a322-e665ce3d3a15', 'volume_size': 1}
Sep 10 12:07:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:07:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:07:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-481333753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc96a680-2831-437e-a322-e665ce3d3a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d05f30e9ff01438c8ad005b9f452468e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:07:37Z,use_quota=True,user_id='a1ad3849e1134c1e8fc7a24f0d696a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:07:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Creating volume dc96a680-2831-437e-a322-e665ce3d3a15 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:07:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:07:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:07:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:07:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:07:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:07:37 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:07:37 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:07:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-dc96a680-2831-437e-a322-e665ce3d3a15 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:38 devstack quobyte-client[82616]: System call of process 99569 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:07:38 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=146, name=volume-dc96a680-2831-437e-a322-e665ce3d3a15, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:07:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234ce072-46d4-45a8-8c48-c0bb4f086e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-938419965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c1d7b14-3f95-4557-ba47-cea9de3710a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00eccbaddaa44a0983ef13caf0dc316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:07:37Z,use_quota=True,user_id='3a9454cff9ba457288ac5175224859d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9834ebd0-cc75-4fe1-b4b8-06d53c79ef23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9834ebd0-cc75-4fe1-b4b8-06d53c79ef23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a755886-7034-440e-bd29-b2d34e753d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a755886-7034-440e-bd29-b2d34e753d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c1d7b14-3f95-4557-ba47-cea9de3710a2', 'volume_name': 'volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd72b31-bf4b-437a-a6f5-581dd54195dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd72b31-bf4b-437a-a6f5-581dd54195dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:38 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5984f17e-eaa4-4c84-ae05-be21234283dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:38 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume 7c1d7b14-3f95-4557-ba47-cea9de3710a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2', 'volume_size': 1}
Sep 10 12:07:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:07:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-dc96a680-2831-437e-a322-e665ce3d3a15 1073741824" returned: 0 in 1.061s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:38 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-dc96a680-2831-437e-a322-e665ce3d3a15 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:39 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Flow 'volume_create_manager' (4950ae5b-b024-4cac-9373-26d5c4b5d4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf33ce19-c8f0-424b-80fa-503c3d70a304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf33ce19-c8f0-424b-80fa-503c3d70a304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1098260390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c60195fa-c5fa-4a2a-b5bb-08d4bce60ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d05f30e9ff01438c8ad005b9f452468e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:07:38Z,use_quota=True,user_id='a1ad3849e1134c1e8fc7a24f0d696a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25891199-3845-48cc-a322-a34e8299b64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25891199-3845-48cc-a322-a34e8299b64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (742e2cb1-d47b-47bf-99c5-3c0569b7ffde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (742e2cb1-d47b-47bf-99c5-3c0569b7ffde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c60195fa-c5fa-4a2a-b5bb-08d4bce60ec8', 'volume_name': 'volume-c60195fa-c5fa-4a2a-b5bb-08d4bce60ec8', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97db518-bf13-455e-a8fa-ea06127e91fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97db518-bf13-455e-a8fa-ea06127e91fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2652991-e853-4664-9cfe-34881eeb635b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:39 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Volume c60195fa-c5fa-4a2a-b5bb-08d4bce60ec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c60195fa-c5fa-4a2a-b5bb-08d4bce60ec8', 'volume_size': 1}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:07:39 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Flow 'volume_create_manager' (0660e25c-1f65-45e8-acf1-2a7f0143eb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (863d5033-7cab-475e-83b9-ed6af2a70957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (863d5033-7cab-475e-83b9-ed6af2a70957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-924905668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782a166a-b81e-4ea3-95a0-e5e5a80bfd2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d05f30e9ff01438c8ad005b9f452468e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:07:37Z,use_quota=True,user_id='a1ad3849e1134c1e8fc7a24f0d696a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48ff473f-1b9c-42b2-ba74-e1de30b5cb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48ff473f-1b9c-42b2-ba74-e1de30b5cb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4db8eb-f526-4d0e-82c0-1c5f2bfe0a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4db8eb-f526-4d0e-82c0-1c5f2bfe0a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '782a166a-b81e-4ea3-95a0-e5e5a80bfd2d', 'volume_name': 'volume-782a166a-b81e-4ea3-95a0-e5e5a80bfd2d', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b640f39-7a36-4933-ae09-f5f9b672791b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b640f39-7a36-4933-ae09-f5f9b672791b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9102bef5-2064-49b2-9333-24dec38289cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:39 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Volume 782a166a-b81e-4ea3-95a0-e5e5a80bfd2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-782a166a-b81e-4ea3-95a0-e5e5a80bfd2d', 'volume_size': 1}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-dc96a680-2831-437e-a322-e665ce3d3a15" returned: 0 in 0.747s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] <== create_volume: return (1837ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.053s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-938419965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c1d7b14-3f95-4557-ba47-cea9de3710a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00eccbaddaa44a0983ef13caf0dc316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:07:37Z,use_quota=True,user_id='3a9454cff9ba457288ac5175224859d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Creating volume 7c1d7b14-3f95-4557-ba47-cea9de3710a2 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:07:39 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:39 devstack quobyte-client[82616]: System call of process 99573 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:07:39 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:07:39 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=147, name=volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:07:39 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:07:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Flow 'volume_create_manager' (ec242177-abe3-4314-8de0-018a2f33661f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:07:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c0c7f1-286d-4c0e-94ff-bdee5815cbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c0c7f1-286d-4c0e-94ff-bdee5815cbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-970994527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58724413-f06c-4370-840e-ff51e421628c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d05f30e9ff01438c8ad005b9f452468e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:07:39Z,use_quota=True,user_id='a1ad3849e1134c1e8fc7a24f0d696a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1810174-11f7-4ee5-aee9-b1ee1938b741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1810174-11f7-4ee5-aee9-b1ee1938b741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb55d26f-26bd-4788-9027-3640162197a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb55d26f-26bd-4788-9027-3640162197a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58724413-f06c-4370-840e-ff51e421628c', 'volume_name': 'volume-58724413-f06c-4370-840e-ff51e421628c', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de6239f-3e4f-4c6d-9f05-1d1db8388b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de6239f-3e4f-4c6d-9f05-1d1db8388b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c832c9-5961-4732-8405-d0a90dee51aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:40 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Volume 58724413-f06c-4370-840e-ff51e421628c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58724413-f06c-4370-840e-ff51e421628c', 'volume_size': 1}
Sep 10 12:07:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:07:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb6018a-c8ed-44d7-af4e-52718a436a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc96a680-2831-437e-a322-e665ce3d3a15', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae16bea-89cb-4f76-b1bb-feee97853754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2 1073741824" returned: 0 in 0.890s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:40 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Volume volume-dc96a680-2831-437e-a322-e665ce3d3a15 (dc96a680-2831-437e-a322-e665ce3d3a15): created successfully
Sep 10 12:07:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae16bea-89cb-4f76-b1bb-feee97853754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:40 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Flow 'volume_create_manager' (3cbd3833-c66e-4e8d-a796-397dfa633b78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:07:40 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Flow 'volume_create_manager' (f643790b-900a-497a-b5ee-97fefd8fb754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74fb82ef-f6a0-4dab-80da-3b4e60249d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74fb82ef-f6a0-4dab-80da-3b4e60249d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-84295427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ab32d2-2569-471a-a315-2b150ba80fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d05f30e9ff01438c8ad005b9f452468e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:07:40Z,use_quota=True,user_id='a1ad3849e1134c1e8fc7a24f0d696a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4d616ac-82ea-4d52-98a3-d919731055f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4d616ac-82ea-4d52-98a3-d919731055f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (516ec080-5639-4e40-abd5-3c7b57d864a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (516ec080-5639-4e40-abd5-3c7b57d864a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6ab32d2-2569-471a-a315-2b150ba80fda', 'volume_name': 'volume-c6ab32d2-2569-471a-a315-2b150ba80fda', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (499cc464-c242-42f5-812b-e8f4751de544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (499cc464-c242-42f5-812b-e8f4751de544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f287d538-0ff3-42b6-9179-ea089c1add5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:41 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Volume c6ab32d2-2569-471a-a315-2b150ba80fda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6ab32d2-2569-471a-a315-2b150ba80fda', 'volume_size': 1}
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:07:41 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-40b39c19-139b-4121-b5ef-6739b38de620 tempest-CreateVolumesFromImageTest-428393646 None] Created volume successfully.
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2" returned: 0 in 0.641s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] <== create_volume: return (1570ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.777s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1098260390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c60195fa-c5fa-4a2a-b5bb-08d4bce60ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d05f30e9ff01438c8ad005b9f452468e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:07:38Z,use_quota=True,user_id='a1ad3849e1134c1e8fc7a24f0d696a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Creating volume c60195fa-c5fa-4a2a-b5bb-08d4bce60ec8 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:07:41 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c60195fa-c5fa-4a2a-b5bb-08d4bce60ec8 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:41 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=148, name=volume-c60195fa-c5fa-4a2a-b5bb-08d4bce60ec8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5984f17e-eaa4-4c84-ae05-be21234283dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06b373d8-9495-4a03-b6bd-af55196075d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c60195fa-c5fa-4a2a-b5bb-08d4bce60ec8 1073741824" returned: 0 in 0.496s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c60195fa-c5fa-4a2a-b5bb-08d4bce60ec8 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:41 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2 (7c1d7b14-3f95-4557-ba47-cea9de3710a2): created successfully
Sep 10 12:07:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06b373d8-9495-4a03-b6bd-af55196075d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Flow 'volume_create_manager' (7839c5f2-eef6-44f0-aad4-d3d7aad32e0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:07:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c60195fa-c5fa-4a2a-b5bb-08d4bce60ec8" returned: 0 in 0.400s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:42 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] <== create_volume: return (915ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:07:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:07:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.561s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:07:42 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-924905668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782a166a-b81e-4ea3-95a0-e5e5a80bfd2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d05f30e9ff01438c8ad005b9f452468e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:07:37Z,use_quota=True,user_id='a1ad3849e1134c1e8fc7a24f0d696a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:07:42 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Creating volume 782a166a-b81e-4ea3-95a0-e5e5a80bfd2d {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:07:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:07:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:07:42 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:07:42 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:07:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:07:42 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:07:42 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:07:42 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-782a166a-b81e-4ea3-95a0-e5e5a80bfd2d 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:42 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-607e4437-309f-4e5d-a102-a295b557bd30 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Created volume successfully.
Sep 10 12:07:42 devstack quobyte-client[82616]: System call of process 99582 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:07:42 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=149, name=volume-782a166a-b81e-4ea3-95a0-e5e5a80bfd2d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:07:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2652991-e853-4664-9cfe-34881eeb635b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c60195fa-c5fa-4a2a-b5bb-08d4bce60ec8', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51c7958c-09b2-493f-9946-20835063392f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:42 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Volume volume-c60195fa-c5fa-4a2a-b5bb-08d4bce60ec8 (c60195fa-c5fa-4a2a-b5bb-08d4bce60ec8): created successfully
Sep 10 12:07:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51c7958c-09b2-493f-9946-20835063392f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:42 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Flow 'volume_create_manager' (4950ae5b-b024-4cac-9373-26d5c4b5d4d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:07:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-782a166a-b81e-4ea3-95a0-e5e5a80bfd2d 1073741824" returned: 0 in 0.717s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-782a166a-b81e-4ea3-95a0-e5e5a80bfd2d {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:43 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-82538c8e-91ff-48e0-85b9-bdc11fa097d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:07:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-82538c8e-91ff-48e0-85b9-bdc11fa097d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:07:43 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-7aba7826-9693-436c-840f-8a9ce3662d1e tempest-CreateVolumesFromImageTest-428393646 None] Created volume successfully.
Sep 10 12:07:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-782a166a-b81e-4ea3-95a0-e5e5a80bfd2d" returned: 0 in 0.314s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:43 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] <== create_volume: return (1115ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:07:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:07:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.838s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:07:43 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-970994527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58724413-f06c-4370-840e-ff51e421628c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d05f30e9ff01438c8ad005b9f452468e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:07:39Z,use_quota=True,user_id='a1ad3849e1134c1e8fc7a24f0d696a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:07:43 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Creating volume 58724413-f06c-4370-840e-ff51e421628c {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:07:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:07:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:07:43 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:07:43 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:07:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:07:43 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:07:43 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:07:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-58724413-f06c-4370-840e-ff51e421628c 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:43 devstack quobyte-client[82616]: System call of process 99586 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:07:43 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=150, name=volume-58724413-f06c-4370-840e-ff51e421628c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:07:43 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9102bef5-2064-49b2-9333-24dec38289cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-782a166a-b81e-4ea3-95a0-e5e5a80bfd2d', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:43 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (177611a4-787d-4018-9e34-47ef61096ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-58724413-f06c-4370-840e-ff51e421628c 1073741824" returned: 0 in 0.585s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-58724413-f06c-4370-840e-ff51e421628c {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:44 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Volume volume-782a166a-b81e-4ea3-95a0-e5e5a80bfd2d (782a166a-b81e-4ea3-95a0-e5e5a80bfd2d): created successfully
Sep 10 12:07:44 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (177611a4-787d-4018-9e34-47ef61096ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:44 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Flow 'volume_create_manager' (0660e25c-1f65-45e8-acf1-2a7f0143eb14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:07:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-58724413-f06c-4370-840e-ff51e421628c" returned: 0 in 0.403s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] <== create_volume: return (1014ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:07:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:07:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.216s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:07:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-84295427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ab32d2-2569-471a-a315-2b150ba80fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d05f30e9ff01438c8ad005b9f452468e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:07:40Z,use_quota=True,user_id='a1ad3849e1134c1e8fc7a24f0d696a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:07:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Creating volume c6ab32d2-2569-471a-a315-2b150ba80fda {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:07:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:07:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:07:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:07:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:07:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:07:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:07:44 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:07:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c6ab32d2-2569-471a-a315-2b150ba80fda 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:44 devstack quobyte-client[82616]: System call of process 99590 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:07:44 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=151, name=volume-c6ab32d2-2569-471a-a315-2b150ba80fda, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:07:44 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c832c9-5961-4732-8405-d0a90dee51aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58724413-f06c-4370-840e-ff51e421628c', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:44 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8e87ed-e575-4040-b480-f1bdd6d8dbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:44 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-7472dbe7-40fe-4275-98db-9aba7d4a25a8 tempest-CreateVolumesFromImageTest-428393646 None] Created volume successfully.
Sep 10 12:07:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c6ab32d2-2569-471a-a315-2b150ba80fda 1073741824" returned: 0 in 0.491s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c6ab32d2-2569-471a-a315-2b150ba80fda {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:45 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Volume volume-58724413-f06c-4370-840e-ff51e421628c (58724413-f06c-4370-840e-ff51e421628c): created successfully
Sep 10 12:07:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8e87ed-e575-4040-b480-f1bdd6d8dbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Flow 'volume_create_manager' (ec242177-abe3-4314-8de0-018a2f33661f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:07:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c6ab32d2-2569-471a-a315-2b150ba80fda" returned: 0 in 0.495s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:45 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] <== create_volume: return (1013ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:07:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:07:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-82538c8e-91ff-48e0-85b9-bdc11fa097d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.282s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:07:45 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-82538c8e-91ff-48e0-85b9-bdc11fa097d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Creating offline snapshot af3e155e-4e6f-45f5-b04b-49798c6d0530 of volume 7c1d7b14-3f95-4557-ba47-cea9de3710a2 {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 12:07:45 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-adb501ed-c620-4a7e-9a67-2ebadabdbaf5 tempest-CreateVolumesFromImageTest-428393646 None] Created volume successfully.
Sep 10 12:07:45 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c3a78d-91ed-4070-a5d0-9c305bbe7b44]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:07:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-82538c8e-91ff-48e0-85b9-bdc11fa097d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:45 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f287d538-0ff3-42b6-9179-ea089c1add5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6ab32d2-2569-471a-a315-2b150ba80fda', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:46 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce91e5cd-2e12-401d-a06b-14178637642e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:46 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Volume volume-c6ab32d2-2569-471a-a315-2b150ba80fda (c6ab32d2-2569-471a-a315-2b150ba80fda): created successfully
Sep 10 12:07:46 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce91e5cd-2e12-401d-a06b-14178637642e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:46 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Flow 'volume_create_manager' (f643790b-900a-497a-b5ee-97fefd8fb754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:07:46 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-bd0e666d-91f3-4750-b178-31825abd3aaa tempest-CreateVolumesFromImageTest-428393646 None] Created volume successfully.
Sep 10 12:07:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-82538c8e-91ff-48e0-85b9-bdc11fa097d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2" returned: 0 in 0.870s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-82538c8e-91ff-48e0-85b9-bdc11fa097d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2.af3e155e-4e6f-45f5-b04b-49798c6d0530 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:46 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=152, name=volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2.af3e155e-4e6f-45f5-b04b-49798c6d0530, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:07:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-82538c8e-91ff-48e0-85b9-bdc11fa097d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2.af3e155e-4e6f-45f5-b04b-49798c6d0530 1G" returned: 0 in 0.433s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-82538c8e-91ff-48e0-85b9-bdc11fa097d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2 -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2.af3e155e-4e6f-45f5-b04b-49798c6d0530 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-82538c8e-91ff-48e0-85b9-bdc11fa097d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "qemu-img rebase -u -b volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2 -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2.af3e155e-4e6f-45f5-b04b-49798c6d0530" returned: 0 in 0.195s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:47 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-82538c8e-91ff-48e0-85b9-bdc11fa097d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2.af3e155e-4e6f-45f5-b04b-49798c6d0530 is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 12:07:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-82538c8e-91ff-48e0-85b9-bdc11fa097d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2.af3e155e-4e6f-45f5-b04b-49798c6d0530 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:47 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-53c10cdc-0245-41cf-8a5f-e82059b79ee8 tempest-CreateVolumesFromImageTest-428393646 None] Acquiring lock "cinder-c6ab32d2-2569-471a-a315-2b150ba80fda-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:07:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-82538c8e-91ff-48e0-85b9-bdc11fa097d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2.af3e155e-4e6f-45f5-b04b-49798c6d0530" returned: 0 in 0.390s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:47 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-82538c8e-91ff-48e0-85b9-bdc11fa097d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2 -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 12:07:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-82538c8e-91ff-48e0-85b9-bdc11fa097d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2.af3e155e-4e6f-45f5-b04b-49798c6d0530 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:47 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-53c10cdc-0245-41cf-8a5f-e82059b79ee8 tempest-CreateVolumesFromImageTest-428393646 None] Lock "cinder-c6ab32d2-2569-471a-a315-2b150ba80fda-delete_volume" acquired by "delete_volume" :: waited 0.332s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:07:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-82538c8e-91ff-48e0-85b9-bdc11fa097d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2.af3e155e-4e6f-45f5-b04b-49798c6d0530" returned: 0 in 0.399s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-82538c8e-91ff-48e0-85b9-bdc11fa097d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-82538c8e-91ff-48e0-85b9-bdc11fa097d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2.info" returned: 0 in 0.455s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:48 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-82538c8e-91ff-48e0-85b9-bdc11fa097d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2.info is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 12:07:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-82538c8e-91ff-48e0-85b9-bdc11fa097d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:48 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-53c10cdc-0245-41cf-8a5f-e82059b79ee8 tempest-CreateVolumesFromImageTest-428393646 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:07:48 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-53c10cdc-0245-41cf-8a5f-e82059b79ee8 tempest-CreateVolumesFromImageTest-428393646 None] Acquiring lock "cinder-quobyte-c6ab32d2-2569-471a-a315-2b150ba80fda" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:07:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-82538c8e-91ff-48e0-85b9-bdc11fa097d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2.info" returned: 0 in 0.333s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-82538c8e-91ff-48e0-85b9-bdc11fa097d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.410s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:07:49 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-53c10cdc-0245-41cf-8a5f-e82059b79ee8 tempest-CreateVolumesFromImageTest-428393646 None] Lock "cinder-quobyte-c6ab32d2-2569-471a-a315-2b150ba80fda" acquired by "delete_volume" :: waited 0.254s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:07:49 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15d9012-42f0-4e7a-abd9-c2eb1133e3b5]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:07:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-53c10cdc-0245-41cf-8a5f-e82059b79ee8 tempest-CreateVolumesFromImageTest-428393646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c6ab32d2-2569-471a-a315-2b150ba80fda {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:49 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-82538c8e-91ff-48e0-85b9-bdc11fa097d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Create snapshot completed successfully
Sep 10 12:07:49 devstack quobyte-client[82616]: System call of process 99607 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:07:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-53c10cdc-0245-41cf-8a5f-e82059b79ee8 tempest-CreateVolumesFromImageTest-428393646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c6ab32d2-2569-471a-a315-2b150ba80fda" returned: 0 in 0.747s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-53c10cdc-0245-41cf-8a5f-e82059b79ee8 tempest-CreateVolumesFromImageTest-428393646 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c6ab32d2-2569-471a-a315-2b150ba80fda {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-53c10cdc-0245-41cf-8a5f-e82059b79ee8 tempest-CreateVolumesFromImageTest-428393646 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c6ab32d2-2569-471a-a315-2b150ba80fda" returned: 0 in 0.169s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:50 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-53c10cdc-0245-41cf-8a5f-e82059b79ee8 tempest-CreateVolumesFromImageTest-428393646 None] Lock "cinder-quobyte-c6ab32d2-2569-471a-a315-2b150ba80fda" released by "delete_volume" :: held 1.182s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:07:50 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-53c10cdc-0245-41cf-8a5f-e82059b79ee8 tempest-CreateVolumesFromImageTest-428393646 None] Created reservations ['53b0f8e0-4e1b-4d5e-9c45-78305e289a7d', '21ea4f57-5ce7-4d4e-b674-15c4ee414054', '5654fa5c-8986-48b5-a719-37a342530c07', '9e6b1f5a-12f2-499a-9e0a-8b63415eb284'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:07:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-53c10cdc-0245-41cf-8a5f-e82059b79ee8 tempest-CreateVolumesFromImageTest-428393646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:07:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-53c10cdc-0245-41cf-8a5f-e82059b79ee8 tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:07:50 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-53c10cdc-0245-41cf-8a5f-e82059b79ee8 tempest-CreateVolumesFromImageTest-428393646 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:07:50 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-53c10cdc-0245-41cf-8a5f-e82059b79ee8 tempest-CreateVolumesFromImageTest-428393646 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:07:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-53c10cdc-0245-41cf-8a5f-e82059b79ee8 tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:07:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-53c10cdc-0245-41cf-8a5f-e82059b79ee8 tempest-CreateVolumesFromImageTest-428393646 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-53c10cdc-0245-41cf-8a5f-e82059b79ee8 tempest-CreateVolumesFromImageTest-428393646 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.679s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:51 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-53c10cdc-0245-41cf-8a5f-e82059b79ee8 tempest-CreateVolumesFromImageTest-428393646 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:07:51 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:07:51 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:07:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Flow 'volume_create_manager' (1c82c525-0ee2-4615-8e8d-5c61aaac1cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:07:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2175d57e-1cab-4ff9-9eb7-dffce9745c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:52 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-53c10cdc-0245-41cf-8a5f-e82059b79ee8 tempest-CreateVolumesFromImageTest-428393646 None] Deleted volume successfully.
Sep 10 12:07:52 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-0406ebce-eda5-4d04-86a9-24de377c47a3 tempest-CreateVolumesFromImageTest-428393646 None] Acquiring lock "cinder-58724413-f06c-4370-840e-ff51e421628c-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:07:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2175d57e-1cab-4ff9-9eb7-dffce9745c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-589396135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3008babc-9a01-4e89-8a7b-fbc5b3bdbc10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00eccbaddaa44a0983ef13caf0dc316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:07:51Z,use_quota=True,user_id='3a9454cff9ba457288ac5175224859d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ce1947-665b-47e5-9780-4071b82dc3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ce1947-665b-47e5-9780-4071b82dc3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e47000e4-7dc1-4695-bbdb-b6df7d666d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e47000e4-7dc1-4695-bbdb-b6df7d666d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3008babc-9a01-4e89-8a7b-fbc5b3bdbc10', 'volume_name': 'volume-3008babc-9a01-4e89-8a7b-fbc5b3bdbc10', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5821dbb7-992d-4606-b6c9-80404a2c70cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5821dbb7-992d-4606-b6c9-80404a2c70cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22f6fce4-4d81-47ed-9486-6be9ecf5d870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:52 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume 3008babc-9a01-4e89-8a7b-fbc5b3bdbc10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3008babc-9a01-4e89-8a7b-fbc5b3bdbc10', 'volume_size': 1}
Sep 10 12:07:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:07:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:07:52 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-589396135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3008babc-9a01-4e89-8a7b-fbc5b3bdbc10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00eccbaddaa44a0983ef13caf0dc316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:07:51Z,use_quota=True,user_id='3a9454cff9ba457288ac5175224859d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:07:52 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Creating volume 3008babc-9a01-4e89-8a7b-fbc5b3bdbc10 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:07:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:07:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:07:52 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:07:52 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:07:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:07:52 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:07:52 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:07:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3008babc-9a01-4e89-8a7b-fbc5b3bdbc10 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:52 devstack quobyte-client[82616]: System call of process 99613 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:07:52 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=154, name=volume-3008babc-9a01-4e89-8a7b-fbc5b3bdbc10, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:07:53 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:07:53 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:07:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Flow 'volume_create_manager' (714acaf3-84ac-455c-a04f-06cb2c01131f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:07:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a069dab1-9217-4467-8b73-e9705535e0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:53 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-0406ebce-eda5-4d04-86a9-24de377c47a3 tempest-CreateVolumesFromImageTest-428393646 None] Lock "cinder-58724413-f06c-4370-840e-ff51e421628c-delete_volume" acquired by "delete_volume" :: waited 1.039s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:07:53 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-53c10cdc-0245-41cf-8a5f-e82059b79ee8 tempest-CreateVolumesFromImageTest-428393646 None] Lock "cinder-c6ab32d2-2569-471a-a315-2b150ba80fda-delete_volume" released by "delete_volume" :: held 5.475s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:07:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3008babc-9a01-4e89-8a7b-fbc5b3bdbc10 1073741824" returned: 0 in 1.014s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3008babc-9a01-4e89-8a7b-fbc5b3bdbc10 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:53 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:07:53 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:07:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Flow 'volume_create_manager' (506945d7-42c4-462d-aaa4-766b854c1abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:07:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb8d169b-6b5f-4197-a833-bd2f24c7f57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a069dab1-9217-4467-8b73-e9705535e0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1062983391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d21432-e966-4090-8303-50f03a0207cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00eccbaddaa44a0983ef13caf0dc316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:07:52Z,use_quota=True,user_id='3a9454cff9ba457288ac5175224859d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ce975f-dca4-404a-a785-00701b7bdf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ce975f-dca4-404a-a785-00701b7bdf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d67d84-9353-4482-8dfa-90ee34d0fcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d67d84-9353-4482-8dfa-90ee34d0fcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82d21432-e966-4090-8303-50f03a0207cb', 'volume_name': 'volume-82d21432-e966-4090-8303-50f03a0207cb', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dd20e74-5a2e-4b9e-b061-1c4ecb61b5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dd20e74-5a2e-4b9e-b061-1c4ecb61b5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ecd06c-8abd-4702-aedf-c24a1fb48ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:54 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume 82d21432-e966-4090-8303-50f03a0207cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82d21432-e966-4090-8303-50f03a0207cb', 'volume_size': 1}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:07:54 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-0406ebce-eda5-4d04-86a9-24de377c47a3 tempest-CreateVolumesFromImageTest-428393646 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-0406ebce-eda5-4d04-86a9-24de377c47a3 tempest-CreateVolumesFromImageTest-428393646 None] Acquiring lock "cinder-quobyte-58724413-f06c-4370-840e-ff51e421628c" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:07:54 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Flow 'volume_create_manager' (ae0e6c30-3cbf-4f33-9449-cb5104f68ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4658c0c4-2666-4543-8ecd-b26f17c4e6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb8d169b-6b5f-4197-a833-bd2f24c7f57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-536274610',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=801a89c6-0b82-41a3-9195-327a2eab439d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00eccbaddaa44a0983ef13caf0dc316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:07:53Z,use_quota=True,user_id='3a9454cff9ba457288ac5175224859d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e653dfc6-15ae-4c38-af21-314b76fd0296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e653dfc6-15ae-4c38-af21-314b76fd0296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd9352cb-d8eb-434e-ab6b-993625e9acd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd9352cb-d8eb-434e-ab6b-993625e9acd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '801a89c6-0b82-41a3-9195-327a2eab439d', 'volume_name': 'volume-801a89c6-0b82-41a3-9195-327a2eab439d', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5beb2c8e-76fd-43e6-973f-c8aff9002392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5beb2c8e-76fd-43e6-973f-c8aff9002392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (044e0c60-85b0-4467-83e1-84068ab87a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:54 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume 801a89c6-0b82-41a3-9195-327a2eab439d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-801a89c6-0b82-41a3-9195-327a2eab439d', 'volume_size': 1}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3008babc-9a01-4e89-8a7b-fbc5b3bdbc10" returned: 0 in 0.955s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4658c0c4-2666-4543-8ecd-b26f17c4e6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1209118514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25001725-8e2f-40e0-a66c-bdebbaa48efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00eccbaddaa44a0983ef13caf0dc316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:07:53Z,use_quota=True,user_id='3a9454cff9ba457288ac5175224859d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d4d6e77-5912-4aed-8606-7681204bb6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d4d6e77-5912-4aed-8606-7681204bb6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8dffdf5-202e-4c61-ba9d-14c1e53a1219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8dffdf5-202e-4c61-ba9d-14c1e53a1219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25001725-8e2f-40e0-a66c-bdebbaa48efc', 'volume_name': 'volume-25001725-8e2f-40e0-a66c-bdebbaa48efc', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8391b95-d23c-4f13-b584-722566ad418b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8391b95-d23c-4f13-b584-722566ad418b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13150b84-1ed9-4afe-9d5b-668766fc8860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:54 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume 25001725-8e2f-40e0-a66c-bdebbaa48efc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25001725-8e2f-40e0-a66c-bdebbaa48efc', 'volume_size': 1}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] <== create_volume: return (2055ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.061s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.275s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1062983391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d21432-e966-4090-8303-50f03a0207cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00eccbaddaa44a0983ef13caf0dc316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:07:52Z,use_quota=True,user_id='3a9454cff9ba457288ac5175224859d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Creating volume 82d21432-e966-4090-8303-50f03a0207cb {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:07:54 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:07:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-82d21432-e966-4090-8303-50f03a0207cb 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:54 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=155, name=volume-82d21432-e966-4090-8303-50f03a0207cb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:07:55 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-0406ebce-eda5-4d04-86a9-24de377c47a3 tempest-CreateVolumesFromImageTest-428393646 None] Lock "cinder-quobyte-58724413-f06c-4370-840e-ff51e421628c" acquired by "delete_volume" :: waited 0.768s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:07:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22f6fce4-4d81-47ed-9486-6be9ecf5d870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3008babc-9a01-4e89-8a7b-fbc5b3bdbc10', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67752c1-9592-4da8-b709-408f0d1e731f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:55 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[22806352-ce15-4037-a208-a92c9ad1e8ed]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:07:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0406ebce-eda5-4d04-86a9-24de377c47a3 tempest-CreateVolumesFromImageTest-428393646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-58724413-f06c-4370-840e-ff51e421628c {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:55 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:07:55 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:07:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Flow 'volume_create_manager' (5321b45d-1014-48fb-99d3-4b2a541d9a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:07:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be960462-e20a-47de-8578-a4cbcd5bab7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be960462-e20a-47de-8578-a4cbcd5bab7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-26841750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c863548e-cf4f-42d2-9251-523e4271cb47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00eccbaddaa44a0983ef13caf0dc316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:07:54Z,use_quota=True,user_id='3a9454cff9ba457288ac5175224859d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb27a45c-125a-4a27-a8ce-b8c7b73411b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb27a45c-125a-4a27-a8ce-b8c7b73411b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc13723b-e896-4f4b-96d5-794e6628e754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc13723b-e896-4f4b-96d5-794e6628e754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c863548e-cf4f-42d2-9251-523e4271cb47', 'volume_name': 'volume-c863548e-cf4f-42d2-9251-523e4271cb47', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50615dd-f92d-48ba-ab62-acaea6697df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50615dd-f92d-48ba-ab62-acaea6697df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32aa093-847c-4bd9-aa12-17a7994b009e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:55 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume c863548e-cf4f-42d2-9251-523e4271cb47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c863548e-cf4f-42d2-9251-523e4271cb47', 'volume_size': 1}
Sep 10 12:07:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:07:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-82d21432-e966-4090-8303-50f03a0207cb 1073741824" returned: 0 in 1.504s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-82d21432-e966-4090-8303-50f03a0207cb {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:55 devstack quobyte-client[82616]: System call of process 99620 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:07:56 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume volume-3008babc-9a01-4e89-8a7b-fbc5b3bdbc10 (3008babc-9a01-4e89-8a7b-fbc5b3bdbc10): created successfully
Sep 10 12:07:56 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67752c1-9592-4da8-b709-408f0d1e731f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:56 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Flow 'volume_create_manager' (1c82c525-0ee2-4615-8e8d-5c61aaac1cb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:07:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-82d21432-e966-4090-8303-50f03a0207cb" returned: 0 in 0.470s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:56 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] <== create_volume: return (2001ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:07:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:07:56 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-e97cd703-a491-4fe8-a359-7d7f00370bf6 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Created volume successfully.
Sep 10 12:07:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0406ebce-eda5-4d04-86a9-24de377c47a3 tempest-CreateVolumesFromImageTest-428393646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-58724413-f06c-4370-840e-ff51e421628c" returned: 0 in 1.162s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.114s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:07:56 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-536274610',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=801a89c6-0b82-41a3-9195-327a2eab439d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00eccbaddaa44a0983ef13caf0dc316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:07:53Z,use_quota=True,user_id='3a9454cff9ba457288ac5175224859d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:07:56 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Creating volume 801a89c6-0b82-41a3-9195-327a2eab439d {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:07:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:07:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:07:56 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:07:56 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:07:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:07:56 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:07:56 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:07:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-801a89c6-0b82-41a3-9195-327a2eab439d 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0406ebce-eda5-4d04-86a9-24de377c47a3 tempest-CreateVolumesFromImageTest-428393646 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-58724413-f06c-4370-840e-ff51e421628c {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:56 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=156, name=volume-801a89c6-0b82-41a3-9195-327a2eab439d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:07:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0406ebce-eda5-4d04-86a9-24de377c47a3 tempest-CreateVolumesFromImageTest-428393646 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-58724413-f06c-4370-840e-ff51e421628c" returned: 0 in 0.447s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ecd06c-8abd-4702-aedf-c24a1fb48ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82d21432-e966-4090-8303-50f03a0207cb', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccfca373-dbf5-4350-b001-91aa40c841dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-801a89c6-0b82-41a3-9195-327a2eab439d 1073741824" returned: 0 in 0.727s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-801a89c6-0b82-41a3-9195-327a2eab439d {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:57 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-0406ebce-eda5-4d04-86a9-24de377c47a3 tempest-CreateVolumesFromImageTest-428393646 None] Lock "cinder-quobyte-58724413-f06c-4370-840e-ff51e421628c" released by "delete_volume" :: held 2.395s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:07:57 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume volume-82d21432-e966-4090-8303-50f03a0207cb (82d21432-e966-4090-8303-50f03a0207cb): created successfully
Sep 10 12:07:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccfca373-dbf5-4350-b001-91aa40c841dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:57 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Flow 'volume_create_manager' (714acaf3-84ac-455c-a04f-06cb2c01131f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:07:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-801a89c6-0b82-41a3-9195-327a2eab439d" returned: 0 in 0.584s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] <== create_volume: return (1340ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:07:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:07:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.426s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:07:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1209118514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25001725-8e2f-40e0-a66c-bdebbaa48efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00eccbaddaa44a0983ef13caf0dc316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:07:53Z,use_quota=True,user_id='3a9454cff9ba457288ac5175224859d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:07:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Creating volume 25001725-8e2f-40e0-a66c-bdebbaa48efc {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:07:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:07:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:07:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:07:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:07:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:07:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:07:57 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:07:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-25001725-8e2f-40e0-a66c-bdebbaa48efc 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:58 devstack quobyte-client[82616]: System call of process 99629 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:07:58 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=157, name=volume-25001725-8e2f-40e0-a66c-bdebbaa48efc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:07:58 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-40a5e49d-7e98-4008-91e1-9eb6ee34881d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Created volume successfully.
Sep 10 12:07:58 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (044e0c60-85b0-4467-83e1-84068ab87a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-801a89c6-0b82-41a3-9195-327a2eab439d', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:58 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (035aed08-bf84-4ff8-9735-75370e3b5b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:58 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume volume-801a89c6-0b82-41a3-9195-327a2eab439d (801a89c6-0b82-41a3-9195-327a2eab439d): created successfully
Sep 10 12:07:58 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (035aed08-bf84-4ff8-9735-75370e3b5b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:58 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Flow 'volume_create_manager' (506945d7-42c4-462d-aaa4-766b854c1abb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:07:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-25001725-8e2f-40e0-a66c-bdebbaa48efc 1073741824" returned: 0 in 0.662s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-25001725-8e2f-40e0-a66c-bdebbaa48efc {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:58 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-2622013f-51ee-4a8d-8995-cc03866f84ee tempest-CreateVolumesFromSnapshotTest-1990013727 None] Created volume successfully.
Sep 10 12:07:58 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-0406ebce-eda5-4d04-86a9-24de377c47a3 tempest-CreateVolumesFromImageTest-428393646 None] Created reservations ['d99cda30-3b68-43e0-9c6a-ba25d6c98a46', '4759aa34-29c6-4e2d-addf-ad1301b6d550', 'dc34f980-db63-49cc-bbfb-87148187d66b', '2c0571e0-d625-4542-8082-7301339c9ba8'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:07:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-25001725-8e2f-40e0-a66c-bdebbaa48efc" returned: 0 in 0.454s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:58 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] <== create_volume: return (1144ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:07:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:07:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.090s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:07:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-26841750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c863548e-cf4f-42d2-9251-523e4271cb47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00eccbaddaa44a0983ef13caf0dc316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:07:54Z,use_quota=True,user_id='3a9454cff9ba457288ac5175224859d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:07:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Creating volume c863548e-cf4f-42d2-9251-523e4271cb47 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:07:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:07:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:07:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:07:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:07:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:07:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:07:59 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:07:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c863548e-cf4f-42d2-9251-523e4271cb47 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:59 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=158, name=volume-c863548e-cf4f-42d2-9251-523e4271cb47, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:07:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13150b84-1ed9-4afe-9d5b-668766fc8860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25001725-8e2f-40e0-a66c-bdebbaa48efc', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:07:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7561f4e-7912-46bc-8502-f88c16532866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:07:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c863548e-cf4f-42d2-9251-523e4271cb47 1073741824" returned: 0 in 0.647s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:07:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c863548e-cf4f-42d2-9251-523e4271cb47 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:07:59 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume volume-25001725-8e2f-40e0-a66c-bdebbaa48efc (25001725-8e2f-40e0-a66c-bdebbaa48efc): created successfully
Sep 10 12:08:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7561f4e-7912-46bc-8502-f88c16532866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Flow 'volume_create_manager' (ae0e6c30-3cbf-4f33-9449-cb5104f68ff3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:08:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c863548e-cf4f-42d2-9251-523e4271cb47" returned: 0 in 0.483s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] <== create_volume: return (1162ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:08:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:00 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-5d125bc7-3b48-425e-a75c-a356bdfd5605 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Created volume successfully.
Sep 10 12:08:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32aa093-847c-4bd9-aa12-17a7994b009e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c863548e-cf4f-42d2-9251-523e4271cb47', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c1deb0-129e-4813-92cb-f2c92d5e5275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0406ebce-eda5-4d04-86a9-24de377c47a3 tempest-CreateVolumesFromImageTest-428393646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0406ebce-eda5-4d04-86a9-24de377c47a3 tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0406ebce-eda5-4d04-86a9-24de377c47a3 tempest-CreateVolumesFromImageTest-428393646 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:08:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0406ebce-eda5-4d04-86a9-24de377c47a3 tempest-CreateVolumesFromImageTest-428393646 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:08:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0406ebce-eda5-4d04-86a9-24de377c47a3 tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0406ebce-eda5-4d04-86a9-24de377c47a3 tempest-CreateVolumesFromImageTest-428393646 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:00 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume volume-c863548e-cf4f-42d2-9251-523e4271cb47 (c863548e-cf4f-42d2-9251-523e4271cb47): created successfully
Sep 10 12:08:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c1deb0-129e-4813-92cb-f2c92d5e5275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Flow 'volume_create_manager' (5321b45d-1014-48fb-99d3-4b2a541d9a90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:08:00 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-108bd2fa-d5b4-4515-b628-f1a1da83ee1d tempest-CreateVolumesFromImageTest-428393646 None] Acquiring lock "cinder-c60195fa-c5fa-4a2a-b5bb-08d4bce60ec8-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:00 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-825ab24e-07b8-46b1-bfac-353a1444b627 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Created volume successfully.
Sep 10 12:08:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0406ebce-eda5-4d04-86a9-24de377c47a3 tempest-CreateVolumesFromImageTest-428393646 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.568s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:00 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-0406ebce-eda5-4d04-86a9-24de377c47a3 tempest-CreateVolumesFromImageTest-428393646 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:08:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-108bd2fa-d5b4-4515-b628-f1a1da83ee1d tempest-CreateVolumesFromImageTest-428393646 None] Lock "cinder-c60195fa-c5fa-4a2a-b5bb-08d4bce60ec8-delete_volume" acquired by "delete_volume" :: waited 0.119s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:01 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-0406ebce-eda5-4d04-86a9-24de377c47a3 tempest-CreateVolumesFromImageTest-428393646 None] Deleted volume successfully.
Sep 10 12:08:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-0406ebce-eda5-4d04-86a9-24de377c47a3 tempest-CreateVolumesFromImageTest-428393646 None] Lock "cinder-58724413-f06c-4370-840e-ff51e421628c-delete_volume" released by "delete_volume" :: held 7.878s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:01 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-108bd2fa-d5b4-4515-b628-f1a1da83ee1d tempest-CreateVolumesFromImageTest-428393646 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:08:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-108bd2fa-d5b4-4515-b628-f1a1da83ee1d tempest-CreateVolumesFromImageTest-428393646 None] Acquiring lock "cinder-quobyte-c60195fa-c5fa-4a2a-b5bb-08d4bce60ec8" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-108bd2fa-d5b4-4515-b628-f1a1da83ee1d tempest-CreateVolumesFromImageTest-428393646 None] Lock "cinder-quobyte-c60195fa-c5fa-4a2a-b5bb-08d4bce60ec8" acquired by "delete_volume" :: waited 0.017s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:01 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ee4466-8f31-43e9-923f-5463a16b6c05]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:08:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-108bd2fa-d5b4-4515-b628-f1a1da83ee1d tempest-CreateVolumesFromImageTest-428393646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c60195fa-c5fa-4a2a-b5bb-08d4bce60ec8 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ead1333a-7e9a-4a24-a0f0-6367da13535b tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "cinder-c863548e-cf4f-42d2-9251-523e4271cb47-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:01 devstack quobyte-client[82616]: System call of process 99640 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:08:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-108bd2fa-d5b4-4515-b628-f1a1da83ee1d tempest-CreateVolumesFromImageTest-428393646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c60195fa-c5fa-4a2a-b5bb-08d4bce60ec8" returned: 0 in 0.647s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ead1333a-7e9a-4a24-a0f0-6367da13535b tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-c863548e-cf4f-42d2-9251-523e4271cb47-delete_volume" acquired by "delete_volume" :: waited 0.136s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-108bd2fa-d5b4-4515-b628-f1a1da83ee1d tempest-CreateVolumesFromImageTest-428393646 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c60195fa-c5fa-4a2a-b5bb-08d4bce60ec8 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-108bd2fa-d5b4-4515-b628-f1a1da83ee1d tempest-CreateVolumesFromImageTest-428393646 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c60195fa-c5fa-4a2a-b5bb-08d4bce60ec8" returned: 0 in 0.297s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:02 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-108bd2fa-d5b4-4515-b628-f1a1da83ee1d tempest-CreateVolumesFromImageTest-428393646 None] Lock "cinder-quobyte-c60195fa-c5fa-4a2a-b5bb-08d4bce60ec8" released by "delete_volume" :: held 1.192s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:02 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-ead1333a-7e9a-4a24-a0f0-6367da13535b tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:08:02 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ead1333a-7e9a-4a24-a0f0-6367da13535b tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "cinder-quobyte-c863548e-cf4f-42d2-9251-523e4271cb47" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:02 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ead1333a-7e9a-4a24-a0f0-6367da13535b tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-quobyte-c863548e-cf4f-42d2-9251-523e4271cb47" acquired by "delete_volume" :: waited 0.035s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:02 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[54046da3-a86a-4b42-9258-25091be07a3f]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:08:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ead1333a-7e9a-4a24-a0f0-6367da13535b tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c863548e-cf4f-42d2-9251-523e4271cb47 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:03 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-108bd2fa-d5b4-4515-b628-f1a1da83ee1d tempest-CreateVolumesFromImageTest-428393646 None] Created reservations ['e8fb1645-e8e4-4e2f-b81e-20d869dac0b6', 'c54969e9-1d28-4b64-bd28-fb7cd3068f0d', 'f81006a0-1446-401d-bd8c-cd91c7a3789a', '62b2b062-a1d6-4e2d-ab4f-90e075a84fcd'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:08:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ead1333a-7e9a-4a24-a0f0-6367da13535b tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c863548e-cf4f-42d2-9251-523e4271cb47" returned: 0 in 0.756s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ead1333a-7e9a-4a24-a0f0-6367da13535b tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c863548e-cf4f-42d2-9251-523e4271cb47 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ead1333a-7e9a-4a24-a0f0-6367da13535b tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c863548e-cf4f-42d2-9251-523e4271cb47" returned: 0 in 0.275s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-108bd2fa-d5b4-4515-b628-f1a1da83ee1d tempest-CreateVolumesFromImageTest-428393646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-108bd2fa-d5b4-4515-b628-f1a1da83ee1d tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-108bd2fa-d5b4-4515-b628-f1a1da83ee1d tempest-CreateVolumesFromImageTest-428393646 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:08:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-108bd2fa-d5b4-4515-b628-f1a1da83ee1d tempest-CreateVolumesFromImageTest-428393646 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:08:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-108bd2fa-d5b4-4515-b628-f1a1da83ee1d tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-108bd2fa-d5b4-4515-b628-f1a1da83ee1d tempest-CreateVolumesFromImageTest-428393646 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:03 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ead1333a-7e9a-4a24-a0f0-6367da13535b tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-quobyte-c863548e-cf4f-42d2-9251-523e4271cb47" released by "delete_volume" :: held 1.337s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-108bd2fa-d5b4-4515-b628-f1a1da83ee1d tempest-CreateVolumesFromImageTest-428393646 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.352s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:04 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-108bd2fa-d5b4-4515-b628-f1a1da83ee1d tempest-CreateVolumesFromImageTest-428393646 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:08:04 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-108bd2fa-d5b4-4515-b628-f1a1da83ee1d tempest-CreateVolumesFromImageTest-428393646 None] Deleted volume successfully.
Sep 10 12:08:04 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-017e5e23-17e0-47f2-a5a0-e23c51352995 tempest-CreateVolumesFromImageTest-428393646 None] Acquiring lock "cinder-782a166a-b81e-4ea3-95a0-e5e5a80bfd2d-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:04 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-017e5e23-17e0-47f2-a5a0-e23c51352995 tempest-CreateVolumesFromImageTest-428393646 None] Lock "cinder-782a166a-b81e-4ea3-95a0-e5e5a80bfd2d-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:04 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-108bd2fa-d5b4-4515-b628-f1a1da83ee1d tempest-CreateVolumesFromImageTest-428393646 None] Lock "cinder-c60195fa-c5fa-4a2a-b5bb-08d4bce60ec8-delete_volume" released by "delete_volume" :: held 3.410s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:04 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-017e5e23-17e0-47f2-a5a0-e23c51352995 tempest-CreateVolumesFromImageTest-428393646 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:08:04 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-017e5e23-17e0-47f2-a5a0-e23c51352995 tempest-CreateVolumesFromImageTest-428393646 None] Acquiring lock "cinder-quobyte-782a166a-b81e-4ea3-95a0-e5e5a80bfd2d" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:04 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-ead1333a-7e9a-4a24-a0f0-6367da13535b tempest-CreateVolumesFromSnapshotTest-1990013727 None] Created reservations ['1ae9a582-91ef-47d1-982b-600a754c78e0', 'c7f12b06-4c3e-4b66-963a-a5925f3e275d', 'e0e3a028-9c32-4551-a4cd-174b58007585', 'aabedf83-12f7-4afe-8155-75215e2feecc'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:08:04 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-017e5e23-17e0-47f2-a5a0-e23c51352995 tempest-CreateVolumesFromImageTest-428393646 None] Lock "cinder-quobyte-782a166a-b81e-4ea3-95a0-e5e5a80bfd2d" acquired by "delete_volume" :: waited 0.039s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:04 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa08c17-b570-487d-9a92-a03eaf949e84]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:08:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-017e5e23-17e0-47f2-a5a0-e23c51352995 tempest-CreateVolumesFromImageTest-428393646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-782a166a-b81e-4ea3-95a0-e5e5a80bfd2d {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ead1333a-7e9a-4a24-a0f0-6367da13535b tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ead1333a-7e9a-4a24-a0f0-6367da13535b tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.057s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:05 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ead1333a-7e9a-4a24-a0f0-6367da13535b tempest-CreateVolumesFromSnapshotTest-1990013727 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:08:05 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ead1333a-7e9a-4a24-a0f0-6367da13535b tempest-CreateVolumesFromSnapshotTest-1990013727 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:08:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ead1333a-7e9a-4a24-a0f0-6367da13535b tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ead1333a-7e9a-4a24-a0f0-6367da13535b tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:05 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a41264cc-066e-4a36-9e5d-e75d271e7ca1 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "cinder-25001725-8e2f-40e0-a66c-bdebbaa48efc-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ead1333a-7e9a-4a24-a0f0-6367da13535b tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.616s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-017e5e23-17e0-47f2-a5a0-e23c51352995 tempest-CreateVolumesFromImageTest-428393646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-782a166a-b81e-4ea3-95a0-e5e5a80bfd2d" returned: 0 in 1.155s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:05 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-ead1333a-7e9a-4a24-a0f0-6367da13535b tempest-CreateVolumesFromSnapshotTest-1990013727 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:08:05 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-ead1333a-7e9a-4a24-a0f0-6367da13535b tempest-CreateVolumesFromSnapshotTest-1990013727 None] Deleted volume successfully.
Sep 10 12:08:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-017e5e23-17e0-47f2-a5a0-e23c51352995 tempest-CreateVolumesFromImageTest-428393646 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-782a166a-b81e-4ea3-95a0-e5e5a80bfd2d {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:06 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a41264cc-066e-4a36-9e5d-e75d271e7ca1 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-25001725-8e2f-40e0-a66c-bdebbaa48efc-delete_volume" acquired by "delete_volume" :: waited 0.412s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-017e5e23-17e0-47f2-a5a0-e23c51352995 tempest-CreateVolumesFromImageTest-428393646 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-782a166a-b81e-4ea3-95a0-e5e5a80bfd2d" returned: 0 in 0.456s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:06 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ead1333a-7e9a-4a24-a0f0-6367da13535b tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-c863548e-cf4f-42d2-9251-523e4271cb47-delete_volume" released by "delete_volume" :: held 4.471s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:06 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-017e5e23-17e0-47f2-a5a0-e23c51352995 tempest-CreateVolumesFromImageTest-428393646 None] Lock "cinder-quobyte-782a166a-b81e-4ea3-95a0-e5e5a80bfd2d" released by "delete_volume" :: held 1.884s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:06 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-a41264cc-066e-4a36-9e5d-e75d271e7ca1 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:08:06 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a41264cc-066e-4a36-9e5d-e75d271e7ca1 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "cinder-quobyte-25001725-8e2f-40e0-a66c-bdebbaa48efc" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:06 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a41264cc-066e-4a36-9e5d-e75d271e7ca1 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-quobyte-25001725-8e2f-40e0-a66c-bdebbaa48efc" acquired by "delete_volume" :: waited 0.074s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:06 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff19a8c-66ab-4b28-b589-a2b7c06773b1]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:08:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a41264cc-066e-4a36-9e5d-e75d271e7ca1 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-25001725-8e2f-40e0-a66c-bdebbaa48efc {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:07 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-017e5e23-17e0-47f2-a5a0-e23c51352995 tempest-CreateVolumesFromImageTest-428393646 None] Created reservations ['242afa1b-8a55-4dda-9a3b-de34395dddeb', '263b18b1-38c3-44a1-a55e-0b4b34e07614', 'd3e32929-af95-437a-8e6c-7feefcb354c4', '61a6bddb-1f43-4bb5-9380-86e9e5921435'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:08:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-017e5e23-17e0-47f2-a5a0-e23c51352995 tempest-CreateVolumesFromImageTest-428393646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-017e5e23-17e0-47f2-a5a0-e23c51352995 tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:07 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-017e5e23-17e0-47f2-a5a0-e23c51352995 tempest-CreateVolumesFromImageTest-428393646 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:08:07 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-017e5e23-17e0-47f2-a5a0-e23c51352995 tempest-CreateVolumesFromImageTest-428393646 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:08:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-017e5e23-17e0-47f2-a5a0-e23c51352995 tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-017e5e23-17e0-47f2-a5a0-e23c51352995 tempest-CreateVolumesFromImageTest-428393646 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-017e5e23-17e0-47f2-a5a0-e23c51352995 tempest-CreateVolumesFromImageTest-428393646 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.202s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a41264cc-066e-4a36-9e5d-e75d271e7ca1 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-25001725-8e2f-40e0-a66c-bdebbaa48efc" returned: 0 in 1.080s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:07 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-017e5e23-17e0-47f2-a5a0-e23c51352995 tempest-CreateVolumesFromImageTest-428393646 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:08:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a41264cc-066e-4a36-9e5d-e75d271e7ca1 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-25001725-8e2f-40e0-a66c-bdebbaa48efc {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:08 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-017e5e23-17e0-47f2-a5a0-e23c51352995 tempest-CreateVolumesFromImageTest-428393646 None] Deleted volume successfully.
Sep 10 12:08:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-dd0f69ce-e692-40fd-bb3e-3b1f2e85aeec tempest-CreateVolumesFromImageTest-428393646 None] Acquiring lock "cinder-dc96a680-2831-437e-a322-e665ce3d3a15-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a41264cc-066e-4a36-9e5d-e75d271e7ca1 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-25001725-8e2f-40e0-a66c-bdebbaa48efc" returned: 0 in 0.649s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-dd0f69ce-e692-40fd-bb3e-3b1f2e85aeec tempest-CreateVolumesFromImageTest-428393646 None] Lock "cinder-dc96a680-2831-437e-a322-e665ce3d3a15-delete_volume" acquired by "delete_volume" :: waited 0.194s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a41264cc-066e-4a36-9e5d-e75d271e7ca1 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-quobyte-25001725-8e2f-40e0-a66c-bdebbaa48efc" released by "delete_volume" :: held 2.079s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-017e5e23-17e0-47f2-a5a0-e23c51352995 tempest-CreateVolumesFromImageTest-428393646 None] Lock "cinder-782a166a-b81e-4ea3-95a0-e5e5a80bfd2d-delete_volume" released by "delete_volume" :: held 4.330s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:08 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-dd0f69ce-e692-40fd-bb3e-3b1f2e85aeec tempest-CreateVolumesFromImageTest-428393646 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:08:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-dd0f69ce-e692-40fd-bb3e-3b1f2e85aeec tempest-CreateVolumesFromImageTest-428393646 None] Acquiring lock "cinder-quobyte-dc96a680-2831-437e-a322-e665ce3d3a15" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-dd0f69ce-e692-40fd-bb3e-3b1f2e85aeec tempest-CreateVolumesFromImageTest-428393646 None] Lock "cinder-quobyte-dc96a680-2831-437e-a322-e665ce3d3a15" acquired by "delete_volume" :: waited 0.020s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:08 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-a41264cc-066e-4a36-9e5d-e75d271e7ca1 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Created reservations ['b1f729a3-538b-4f4c-a44b-d84288d694ec', 'bb6a4112-c7d6-4397-b42b-d8db1d5e5506', '4069291e-46ba-487c-9c7d-3df1a0117eb9', '5f9794d1-c49d-4127-a4bd-219c1d0980bd'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:08:08 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[532307e3-fe0b-4873-b70c-ee9d4e59be50]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:08:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-dd0f69ce-e692-40fd-bb3e-3b1f2e85aeec tempest-CreateVolumesFromImageTest-428393646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-dc96a680-2831-437e-a322-e665ce3d3a15 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a41264cc-066e-4a36-9e5d-e75d271e7ca1 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a41264cc-066e-4a36-9e5d-e75d271e7ca1 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-a41264cc-066e-4a36-9e5d-e75d271e7ca1 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:08:09 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-a41264cc-066e-4a36-9e5d-e75d271e7ca1 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:08:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-a41264cc-066e-4a36-9e5d-e75d271e7ca1 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a41264cc-066e-4a36-9e5d-e75d271e7ca1 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a41264cc-066e-4a36-9e5d-e75d271e7ca1 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.128s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:09 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-a41264cc-066e-4a36-9e5d-e75d271e7ca1 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:08:09 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-a41264cc-066e-4a36-9e5d-e75d271e7ca1 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Deleted volume successfully.
Sep 10 12:08:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-dd0f69ce-e692-40fd-bb3e-3b1f2e85aeec tempest-CreateVolumesFromImageTest-428393646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-dc96a680-2831-437e-a322-e665ce3d3a15" returned: 0 in 1.119s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-dd0f69ce-e692-40fd-bb3e-3b1f2e85aeec tempest-CreateVolumesFromImageTest-428393646 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-dc96a680-2831-437e-a322-e665ce3d3a15 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:10 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5d532f98-0042-4361-87cf-1513b1be4406 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "cinder-801a89c6-0b82-41a3-9195-327a2eab439d-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:10 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a41264cc-066e-4a36-9e5d-e75d271e7ca1 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-25001725-8e2f-40e0-a66c-bdebbaa48efc-delete_volume" released by "delete_volume" :: held 4.807s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-dd0f69ce-e692-40fd-bb3e-3b1f2e85aeec tempest-CreateVolumesFromImageTest-428393646 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-dc96a680-2831-437e-a322-e665ce3d3a15" returned: 0 in 0.864s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:11 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5d532f98-0042-4361-87cf-1513b1be4406 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-801a89c6-0b82-41a3-9195-327a2eab439d-delete_volume" acquired by "delete_volume" :: waited 0.247s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:11 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-dd0f69ce-e692-40fd-bb3e-3b1f2e85aeec tempest-CreateVolumesFromImageTest-428393646 None] Lock "cinder-quobyte-dc96a680-2831-437e-a322-e665ce3d3a15" released by "delete_volume" :: held 2.221s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:11 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-5d532f98-0042-4361-87cf-1513b1be4406 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:08:11 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5d532f98-0042-4361-87cf-1513b1be4406 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "cinder-quobyte-801a89c6-0b82-41a3-9195-327a2eab439d" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:11 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5d532f98-0042-4361-87cf-1513b1be4406 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-quobyte-801a89c6-0b82-41a3-9195-327a2eab439d" acquired by "delete_volume" :: waited 0.048s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:11 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[62383067-f0fd-41e9-821d-6620776dc8b9]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:08:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5d532f98-0042-4361-87cf-1513b1be4406 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-801a89c6-0b82-41a3-9195-327a2eab439d {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:11 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-dd0f69ce-e692-40fd-bb3e-3b1f2e85aeec tempest-CreateVolumesFromImageTest-428393646 None] Created reservations ['6bf56ee2-3683-4542-a586-5bec6210401c', 'a5bbc363-f298-40b6-891d-3aafc2625304', '37beeb3a-e6cb-47fe-9698-c7538e778125', 'ac175734-82be-4f9e-a146-7f54677bb357'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:08:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-dd0f69ce-e692-40fd-bb3e-3b1f2e85aeec tempest-CreateVolumesFromImageTest-428393646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-dd0f69ce-e692-40fd-bb3e-3b1f2e85aeec tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:12 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-dd0f69ce-e692-40fd-bb3e-3b1f2e85aeec tempest-CreateVolumesFromImageTest-428393646 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:08:12 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-dd0f69ce-e692-40fd-bb3e-3b1f2e85aeec tempest-CreateVolumesFromImageTest-428393646 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:08:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-dd0f69ce-e692-40fd-bb3e-3b1f2e85aeec tempest-CreateVolumesFromImageTest-428393646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-dd0f69ce-e692-40fd-bb3e-3b1f2e85aeec tempest-CreateVolumesFromImageTest-428393646 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:12 devstack quobyte-client[82616]: System call of process 99698 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:08:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-dd0f69ce-e692-40fd-bb3e-3b1f2e85aeec tempest-CreateVolumesFromImageTest-428393646 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.237s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:12 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-dd0f69ce-e692-40fd-bb3e-3b1f2e85aeec tempest-CreateVolumesFromImageTest-428393646 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:08:12 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-dd0f69ce-e692-40fd-bb3e-3b1f2e85aeec tempest-CreateVolumesFromImageTest-428393646 None] Deleted volume successfully.
Sep 10 12:08:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5d532f98-0042-4361-87cf-1513b1be4406 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-801a89c6-0b82-41a3-9195-327a2eab439d" returned: 0 in 1.090s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5d532f98-0042-4361-87cf-1513b1be4406 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-801a89c6-0b82-41a3-9195-327a2eab439d {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:12 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-dd0f69ce-e692-40fd-bb3e-3b1f2e85aeec tempest-CreateVolumesFromImageTest-428393646 None] Lock "cinder-dc96a680-2831-437e-a322-e665ce3d3a15-delete_volume" released by "delete_volume" :: held 4.299s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5d532f98-0042-4361-87cf-1513b1be4406 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-801a89c6-0b82-41a3-9195-327a2eab439d" returned: 0 in 0.346s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:13 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5d532f98-0042-4361-87cf-1513b1be4406 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-quobyte-801a89c6-0b82-41a3-9195-327a2eab439d" released by "delete_volume" :: held 1.518s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:13 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-5d532f98-0042-4361-87cf-1513b1be4406 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Created reservations ['6b4b7e54-4b3e-49db-beff-70652d6d2a87', 'a53cee25-fb01-42cf-addb-9c8c86110c27', '699ce07d-a703-4155-bffe-f27f0157ae8f', '2e56ba13-bf34-449a-bb13-2be164cc10d4'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:08:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5d532f98-0042-4361-87cf-1513b1be4406 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5d532f98-0042-4361-87cf-1513b1be4406 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:13 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5d532f98-0042-4361-87cf-1513b1be4406 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:08:13 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-5d532f98-0042-4361-87cf-1513b1be4406 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:08:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-5d532f98-0042-4361-87cf-1513b1be4406 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5d532f98-0042-4361-87cf-1513b1be4406 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-5d532f98-0042-4361-87cf-1513b1be4406 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.145s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:13 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-5d532f98-0042-4361-87cf-1513b1be4406 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:08:13 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-5d532f98-0042-4361-87cf-1513b1be4406 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Deleted volume successfully.
Sep 10 12:08:14 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-134184b2-ed20-41e3-8d52-b83d9988a45e tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "cinder-82d21432-e966-4090-8303-50f03a0207cb-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:14 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-5d532f98-0042-4361-87cf-1513b1be4406 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-801a89c6-0b82-41a3-9195-327a2eab439d-delete_volume" released by "delete_volume" :: held 3.323s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:14 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-134184b2-ed20-41e3-8d52-b83d9988a45e tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-82d21432-e966-4090-8303-50f03a0207cb-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:14 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-134184b2-ed20-41e3-8d52-b83d9988a45e tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:08:14 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-134184b2-ed20-41e3-8d52-b83d9988a45e tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "cinder-quobyte-82d21432-e966-4090-8303-50f03a0207cb" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:14 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-134184b2-ed20-41e3-8d52-b83d9988a45e tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-quobyte-82d21432-e966-4090-8303-50f03a0207cb" acquired by "delete_volume" :: waited 0.015s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:14 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[17412256-ec1b-4502-95e5-e5eca42d4f96]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:08:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-134184b2-ed20-41e3-8d52-b83d9988a45e tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-82d21432-e966-4090-8303-50f03a0207cb {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:15 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:08:15 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:08:15 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Flow 'volume_create_manager' (7f720460-aef9-42ce-b9ba-dedb48e17082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:08:15 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5101f2-60a0-49e1-a3be-c0c23b562069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:15 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5101f2-60a0-49e1-a3be-c0c23b562069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1323918507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3797444-8854-450d-ae33-461ba65fc5d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309428ac6f8b424c891652128e91b2c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:08:15Z,use_quota=True,user_id='2b5687dd2eb14378ba37544f5a4f682a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:15 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (685e7505-8486-4565-b4fd-34c675ba2ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:15 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (685e7505-8486-4565-b4fd-34c675ba2ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:15 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af5af0b2-50fe-4a00-8713-639e4919e437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:15 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af5af0b2-50fe-4a00-8713-639e4919e437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3797444-8854-450d-ae33-461ba65fc5d8', 'volume_name': 'volume-c3797444-8854-450d-ae33-461ba65fc5d8', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:15 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc23e24e-d144-4f5d-a696-494f07933c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:15 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc23e24e-d144-4f5d-a696-494f07933c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:15 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84c9b8f8-acaf-4ace-bdd4-a87180c54304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:15 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Volume c3797444-8854-450d-ae33-461ba65fc5d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3797444-8854-450d-ae33-461ba65fc5d8', 'volume_size': 1}
Sep 10 12:08:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:15 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1323918507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3797444-8854-450d-ae33-461ba65fc5d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309428ac6f8b424c891652128e91b2c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:08:15Z,use_quota=True,user_id='2b5687dd2eb14378ba37544f5a4f682a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:08:15 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Creating volume c3797444-8854-450d-ae33-461ba65fc5d8 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:08:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:15 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:08:15 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:08:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:15 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:08:15 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:08:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-134184b2-ed20-41e3-8d52-b83d9988a45e tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-82d21432-e966-4090-8303-50f03a0207cb" returned: 0 in 1.085s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:15 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=159, name=volume-c3797444-8854-450d-ae33-461ba65fc5d8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:08:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-134184b2-ed20-41e3-8d52-b83d9988a45e tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-82d21432-e966-4090-8303-50f03a0207cb {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-134184b2-ed20-41e3-8d52-b83d9988a45e tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-82d21432-e966-4090-8303-50f03a0207cb" returned: 0 in 0.136s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-134184b2-ed20-41e3-8d52-b83d9988a45e tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-quobyte-82d21432-e966-4090-8303-50f03a0207cb" released by "delete_volume" :: held 1.556s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8 1073741824" returned: 0 in 0.788s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8" returned: 0 in 0.314s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:16 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] <== create_volume: return (1175ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:08:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:16 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84c9b8f8-acaf-4ace-bdd4-a87180c54304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3797444-8854-450d-ae33-461ba65fc5d8', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:16 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b12bc318-9111-46b2-9e40-97d355b09bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:16 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Volume volume-c3797444-8854-450d-ae33-461ba65fc5d8 (c3797444-8854-450d-ae33-461ba65fc5d8): created successfully
Sep 10 12:08:16 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b12bc318-9111-46b2-9e40-97d355b09bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:16 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Flow 'volume_create_manager' (7f720460-aef9-42ce-b9ba-dedb48e17082) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:08:16 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-134184b2-ed20-41e3-8d52-b83d9988a45e tempest-CreateVolumesFromSnapshotTest-1990013727 None] Created reservations ['46349630-4ea6-4bb3-9eb3-ac931f2b02cd', '61c5dcdc-4024-4df0-9171-db758d4fdacb', 'c8f2fea0-1575-4c32-b1f4-d34ca6a14cd8', 'e05aa98b-fb68-49ff-b21f-f09b040ba4d7'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:08:16 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-538131cc-1325-4506-a32a-1d005facf4f6 tempest-SnapshotDependencyTests-1076138028 None] Created volume successfully.
Sep 10 12:08:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-134184b2-ed20-41e3-8d52-b83d9988a45e tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-134184b2-ed20-41e3-8d52-b83d9988a45e tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:17 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-134184b2-ed20-41e3-8d52-b83d9988a45e tempest-CreateVolumesFromSnapshotTest-1990013727 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:08:17 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-134184b2-ed20-41e3-8d52-b83d9988a45e tempest-CreateVolumesFromSnapshotTest-1990013727 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:08:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-134184b2-ed20-41e3-8d52-b83d9988a45e tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-134184b2-ed20-41e3-8d52-b83d9988a45e tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-134184b2-ed20-41e3-8d52-b83d9988a45e tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.109s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:17 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-134184b2-ed20-41e3-8d52-b83d9988a45e tempest-CreateVolumesFromSnapshotTest-1990013727 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:08:17 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-134184b2-ed20-41e3-8d52-b83d9988a45e tempest-CreateVolumesFromSnapshotTest-1990013727 None] Deleted volume successfully.
Sep 10 12:08:17 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-134184b2-ed20-41e3-8d52-b83d9988a45e tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-82d21432-e966-4090-8303-50f03a0207cb-delete_volume" released by "delete_volume" :: held 3.295s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:17 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b3bfff57-d3bc-414a-8bef-5b4bb8adfe7d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "cinder-3008babc-9a01-4e89-8a7b-fbc5b3bdbc10-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:18 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b3bfff57-d3bc-414a-8bef-5b4bb8adfe7d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-3008babc-9a01-4e89-8a7b-fbc5b3bdbc10-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:18 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-b3bfff57-d3bc-414a-8bef-5b4bb8adfe7d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:08:18 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b3bfff57-d3bc-414a-8bef-5b4bb8adfe7d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "cinder-quobyte-3008babc-9a01-4e89-8a7b-fbc5b3bdbc10" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:18 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b3bfff57-d3bc-414a-8bef-5b4bb8adfe7d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-quobyte-3008babc-9a01-4e89-8a7b-fbc5b3bdbc10" acquired by "delete_volume" :: waited 0.022s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:18 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63ad724-1ed8-482c-9d83-effa614d5a55]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:08:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b3bfff57-d3bc-414a-8bef-5b4bb8adfe7d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3008babc-9a01-4e89-8a7b-fbc5b3bdbc10 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b3bfff57-d3bc-414a-8bef-5b4bb8adfe7d tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3008babc-9a01-4e89-8a7b-fbc5b3bdbc10" returned: 0 in 0.743s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b3bfff57-d3bc-414a-8bef-5b4bb8adfe7d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3008babc-9a01-4e89-8a7b-fbc5b3bdbc10 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:19 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-40ffbf53-7f04-4a33-a296-0d2057f0c049 tempest-SnapshotDependencyTests-1076138028 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:08:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-40ffbf53-7f04-4a33-a296-0d2057f0c049 tempest-SnapshotDependencyTests-1076138028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-40ffbf53-7f04-4a33-a296-0d2057f0c049 tempest-SnapshotDependencyTests-1076138028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b3bfff57-d3bc-414a-8bef-5b4bb8adfe7d tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3008babc-9a01-4e89-8a7b-fbc5b3bdbc10" returned: 0 in 0.333s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:19 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-40ffbf53-7f04-4a33-a296-0d2057f0c049 tempest-SnapshotDependencyTests-1076138028 None] Creating offline snapshot 5299ae4d-8aec-4888-b793-257ed892203f of volume c3797444-8854-450d-ae33-461ba65fc5d8 {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 12:08:19 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b3bfff57-d3bc-414a-8bef-5b4bb8adfe7d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-quobyte-3008babc-9a01-4e89-8a7b-fbc5b3bdbc10" released by "delete_volume" :: held 1.284s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:19 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde062c9-9e1b-494c-861b-9842c8e8092d]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:08:19 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-40ffbf53-7f04-4a33-a296-0d2057f0c049 tempest-SnapshotDependencyTests-1076138028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:20 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-b3bfff57-d3bc-414a-8bef-5b4bb8adfe7d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Created reservations ['b1ff1ef4-3a0a-4d5d-a202-22d636e8d84e', '5729e0ed-5878-4740-8d13-df0e45c759bf', '79d0b06c-3e70-49bb-a39e-14783add6aa4', 'c1f0b3a9-37b5-4a1d-ad51-9e2d60a51dd0'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:08:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b3bfff57-d3bc-414a-8bef-5b4bb8adfe7d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b3bfff57-d3bc-414a-8bef-5b4bb8adfe7d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:20 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b3bfff57-d3bc-414a-8bef-5b4bb8adfe7d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:08:20 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b3bfff57-d3bc-414a-8bef-5b4bb8adfe7d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:08:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b3bfff57-d3bc-414a-8bef-5b4bb8adfe7d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b3bfff57-d3bc-414a-8bef-5b4bb8adfe7d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-40ffbf53-7f04-4a33-a296-0d2057f0c049 tempest-SnapshotDependencyTests-1076138028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8" returned: 0 in 1.122s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-40ffbf53-7f04-4a33-a296-0d2057f0c049 tempest-SnapshotDependencyTests-1076138028 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8.5299ae4d-8aec-4888-b793-257ed892203f 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:20 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b3bfff57-d3bc-414a-8bef-5b4bb8adfe7d tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.284s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:20 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-b3bfff57-d3bc-414a-8bef-5b4bb8adfe7d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:08:20 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=160, name=volume-c3797444-8854-450d-ae33-461ba65fc5d8.5299ae4d-8aec-4888-b793-257ed892203f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:08:21 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-b3bfff57-d3bc-414a-8bef-5b4bb8adfe7d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Deleted volume successfully.
Sep 10 12:08:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-40ffbf53-7f04-4a33-a296-0d2057f0c049 tempest-SnapshotDependencyTests-1076138028 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8.5299ae4d-8aec-4888-b793-257ed892203f 1G" returned: 0 in 0.512s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-40ffbf53-7f04-4a33-a296-0d2057f0c049 tempest-SnapshotDependencyTests-1076138028 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c3797444-8854-450d-ae33-461ba65fc5d8 -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8.5299ae4d-8aec-4888-b793-257ed892203f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:21 devstack quobyte-client[82616]: System call of process 99725 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:08:21 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fd614cc6-c008-43ac-a3b7-4aed8cf9b743 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "cinder-af3e155e-4e6f-45f5-b04b-49798c6d0530-delete_snapshot" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-40ffbf53-7f04-4a33-a296-0d2057f0c049 tempest-SnapshotDependencyTests-1076138028 None] CMD "qemu-img rebase -u -b volume-c3797444-8854-450d-ae33-461ba65fc5d8 -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8.5299ae4d-8aec-4888-b793-257ed892203f" returned: 0 in 0.453s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:21 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-40ffbf53-7f04-4a33-a296-0d2057f0c049 tempest-SnapshotDependencyTests-1076138028 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8.5299ae4d-8aec-4888-b793-257ed892203f is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 12:08:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-40ffbf53-7f04-4a33-a296-0d2057f0c049 tempest-SnapshotDependencyTests-1076138028 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8.5299ae4d-8aec-4888-b793-257ed892203f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:21 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b3bfff57-d3bc-414a-8bef-5b4bb8adfe7d tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-3008babc-9a01-4e89-8a7b-fbc5b3bdbc10-delete_volume" released by "delete_volume" :: held 3.841s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:21 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-40ffbf53-7f04-4a33-a296-0d2057f0c049 tempest-SnapshotDependencyTests-1076138028 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8.5299ae4d-8aec-4888-b793-257ed892203f" returned: 0 in 0.268s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:22 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-40ffbf53-7f04-4a33-a296-0d2057f0c049 tempest-SnapshotDependencyTests-1076138028 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8 -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 12:08:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-40ffbf53-7f04-4a33-a296-0d2057f0c049 tempest-SnapshotDependencyTests-1076138028 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8.5299ae4d-8aec-4888-b793-257ed892203f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:22 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fd614cc6-c008-43ac-a3b7-4aed8cf9b743 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-af3e155e-4e6f-45f5-b04b-49798c6d0530-delete_snapshot" acquired by "delete_snapshot" :: waited 0.472s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:22 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-fd614cc6-c008-43ac-a3b7-4aed8cf9b743 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:08:22 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fd614cc6-c008-43ac-a3b7-4aed8cf9b743 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "cinder-quobyte-7c1d7b14-3f95-4557-ba47-cea9de3710a2" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-40ffbf53-7f04-4a33-a296-0d2057f0c049 tempest-SnapshotDependencyTests-1076138028 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8.5299ae4d-8aec-4888-b793-257ed892203f" returned: 0 in 0.327s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:22 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-40ffbf53-7f04-4a33-a296-0d2057f0c049 tempest-SnapshotDependencyTests-1076138028 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:22 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fd614cc6-c008-43ac-a3b7-4aed8cf9b743 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-quobyte-7c1d7b14-3f95-4557-ba47-cea9de3710a2" acquired by "delete_snapshot" :: waited 0.698s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:22 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fd614cc6-c008-43ac-a3b7-4aed8cf9b743 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "cinder-quobyte-af3e155e-4e6f-45f5-b04b-49798c6d0530" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:23 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 12:08:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:23 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:08:23 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:08:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-40ffbf53-7f04-4a33-a296-0d2057f0c049 tempest-SnapshotDependencyTests-1076138028 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8.info" returned: 0 in 1.024s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:23 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-40ffbf53-7f04-4a33-a296-0d2057f0c049 tempest-SnapshotDependencyTests-1076138028 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8.info is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 12:08:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-40ffbf53-7f04-4a33-a296-0d2057f0c049 tempest-SnapshotDependencyTests-1076138028 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:23 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fd614cc6-c008-43ac-a3b7-4aed8cf9b743 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-quobyte-af3e155e-4e6f-45f5-b04b-49798c6d0530" acquired by "_delete_snapshot" :: waited 0.609s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:23 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-fd614cc6-c008-43ac-a3b7-4aed8cf9b743 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Deleting offline snapshot af3e155e-4e6f-45f5-b04b-49798c6d0530 of volume 7c1d7b14-3f95-4557-ba47-cea9de3710a2 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 12:08:23 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-fd614cc6-c008-43ac-a3b7-4aed8cf9b743 tempest-CreateVolumesFromSnapshotTest-1990013727 None] snapshot_file for this snap is: volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2.af3e155e-4e6f-45f5-b04b-49798c6d0530 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 12:08:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.677s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:23 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41a72d5-edc0-4ff1-805b-6aa1607e0976]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:08:23 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:08:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fd614cc6-c008-43ac-a3b7-4aed8cf9b743 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2.af3e155e-4e6f-45f5-b04b-49798c6d0530 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:23 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:08:24 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:08:24 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Flow 'volume_create_manager' (10fe97a4-d41c-40ed-a7ea-2e3c1c4bbeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:08:24 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2efebda9-c977-4b5b-869d-a2412c29212a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-40ffbf53-7f04-4a33-a296-0d2057f0c049 tempest-SnapshotDependencyTests-1076138028 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8.info" returned: 0 in 0.884s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-40ffbf53-7f04-4a33-a296-0d2057f0c049 tempest-SnapshotDependencyTests-1076138028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.042s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:24 devstack quobyte-client[82616]: System call of process 99734 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:08:24 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2efebda9-c977-4b5b-869d-a2412c29212a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=986bd2ea-b707-43fa-bdfa-592545e528d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d178b46b4fae400a8d4b05207869f12a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:08:22Z,use_quota=True,user_id='78c31fff7c4d42cb8083f06c3a44f583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:24 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb4efe1-ed1a-4a29-b0c6-c068055a962a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:24 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb4efe1-ed1a-4a29-b0c6-c068055a962a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:24 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9fa0d6e-a58c-436e-8fcd-9c2eb27afe1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fd614cc6-c008-43ac-a3b7-4aed8cf9b743 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2.af3e155e-4e6f-45f5-b04b-49798c6d0530" returned: 0 in 0.659s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:24 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-fd614cc6-c008-43ac-a3b7-4aed8cf9b743 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 12:08:24 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2983c6a7-445b-4723-bbcf-a0ddb8e5598c]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:08:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fd614cc6-c008-43ac-a3b7-4aed8cf9b743 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:24 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-40ffbf53-7f04-4a33-a296-0d2057f0c049 tempest-SnapshotDependencyTests-1076138028 None] Create snapshot completed successfully
Sep 10 12:08:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9fa0d6e-a58c-436e-8fcd-9c2eb27afe1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '986bd2ea-b707-43fa-bdfa-592545e528d7', 'volume_name': 'volume-986bd2ea-b707-43fa-bdfa-592545e528d7', 'volume_size': 1, 'image_id': 'df44ed4e-b7a1-4776-9bfd-cdf0700d6285', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '623d3c697605c85d9109b0c14cf10b72', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd178b46b4fae400a8d4b05207869f12a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8277bd6d3c84c6af62cf2373d89ef6edc0c45abe4f7e52b71c8a9a44585f5e1a59651b96e6a6ebdfa82896179aeb1a933b360263d5f41f60c4159c847b68853f', 'id': 'df44ed4e-b7a1-4776-9bfd-cdf0700d6285', 'created_at': datetime.datetime(2025, 9, 10, 10, 8, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 10, 8, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df44ed4e-b7a1-4776-9bfd-cdf0700d6285/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4f51a80400>}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce4b6d3-f1f6-46ec-8814-ff77e3200e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce4b6d3-f1f6-46ec-8814-ff77e3200e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:25 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54360b58-f124-472d-b3e0-11b65400a52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:25 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Volume 986bd2ea-b707-43fa-bdfa-592545e528d7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-986bd2ea-b707-43fa-bdfa-592545e528d7', 'volume_size': 1, 'image_id': 'df44ed4e-b7a1-4776-9bfd-cdf0700d6285', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '623d3c697605c85d9109b0c14cf10b72', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd178b46b4fae400a8d4b05207869f12a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8277bd6d3c84c6af62cf2373d89ef6edc0c45abe4f7e52b71c8a9a44585f5e1a59651b96e6a6ebdfa82896179aeb1a933b360263d5f41f60c4159c847b68853f', 'id': 'df44ed4e-b7a1-4776-9bfd-cdf0700d6285', 'created_at': datetime.datetime(2025, 9, 10, 10, 8, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 10, 8, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df44ed4e-b7a1-4776-9bfd-cdf0700d6285/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4f51a80400>}
Sep 10 12:08:25 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Cloning 986bd2ea-b707-43fa-bdfa-592545e528d7 from image df44ed4e-b7a1-4776-9bfd-cdf0700d6285  at location (None, None). {{(pid=82594) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 12:08:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fd614cc6-c008-43ac-a3b7-4aed8cf9b743 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2" returned: 0 in 0.764s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fd614cc6-c008-43ac-a3b7-4aed8cf9b743 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2.af3e155e-4e6f-45f5-b04b-49798c6d0530 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:25 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_a1prslfudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=82594) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 12:08:25 devstack cinder-volume[82594]: INFO cinder.image.image_utils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Image download 0.00 MB at 0.00 MB/s
Sep 10 12:08:25 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc669c0-2021-41b2-9911-c30c6541d812]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:08:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_a1prslfudevstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fd614cc6-c008-43ac-a3b7-4aed8cf9b743 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2.af3e155e-4e6f-45f5-b04b-49798c6d0530" returned: 0 in 0.598s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:25 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fd614cc6-c008-43ac-a3b7-4aed8cf9b743 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2.af3e155e-4e6f-45f5-b04b-49798c6d0530 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:26 devstack sudo[99743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_a1prslfudevstack@QuobyteHD
Sep 10 12:08:26 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fd614cc6-c008-43ac-a3b7-4aed8cf9b743 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2.af3e155e-4e6f-45f5-b04b-49798c6d0530" returned: 0 in 0.421s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fd614cc6-c008-43ac-a3b7-4aed8cf9b743 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-quobyte-af3e155e-4e6f-45f5-b04b-49798c6d0530" released by "_delete_snapshot" :: held 2.919s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:26 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fd614cc6-c008-43ac-a3b7-4aed8cf9b743 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-quobyte-7c1d7b14-3f95-4557-ba47-cea9de3710a2" released by "delete_snapshot" :: held 3.632s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Flow 'volume_create_manager' (ec094148-f46d-4a00-b8f1-d1bac68f94cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (936e52ed-4b27-4b95-b20d-a773a93a24af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (936e52ed-4b27-4b95-b20d-a773a93a24af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309428ac6f8b424c891652128e91b2c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5299ae4d-8aec-4888-b793-257ed892203f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:08:26Z,use_quota=True,user_id='2b5687dd2eb14378ba37544f5a4f682a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11dd6fb7-13d8-46f4-b863-5fef41ab6acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11dd6fb7-13d8-46f4-b863-5fef41ab6acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a041f83-0f6a-48e5-a403-bccd2850b62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a041f83-0f6a-48e5-a403-bccd2850b62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316', 'volume_name': 'volume-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316', 'volume_size': 1, 'snapshot_id': '5299ae4d-8aec-4888-b793-257ed892203f'}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (405c1377-2af0-4bc2-b4b4-e142f9f82427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (405c1377-2af0-4bc2-b4b4-e142f9f82427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (992dbc53-bea7-466d-a98b-92ca7e91d71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:26 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Volume c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316', 'volume_size': 1, 'snapshot_id': '5299ae4d-8aec-4888-b793-257ed892203f'}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Acquiring lock "cinder-quobyte-5299ae4d-8aec-4888-b793-257ed892203f-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316" by "_create_volume_from_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Lock "cinder-quobyte-5299ae4d-8aec-4888-b793-257ed892203f-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Creating volume c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316 from snapshot 5299ae4d-8aec-4888-b793-257ed892203f {{(pid=82594) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Acquiring lock "cinder-quobyte-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316" by "_copy_volume_from_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Lock "cinder-quobyte-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] snapshot: 5299ae4d-8aec-4888-b793-257ed892203f, volume: c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316,  {{(pid=82594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:08:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:27 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f13a765-4df9-4934-8bc1-40e42af20c3e]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:08:27 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-fd614cc6-c008-43ac-a3b7-4aed8cf9b743 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Created reservations ['233eaa2b-a86b-4b3f-82b7-c3981fc826a1', '0a7d2c82-e019-4a61-b859-e6502fc016c2', 'c22cd65c-a4af-4bc6-9380-d694dedf4de5', 'bcd2e3f4-c142-44e1-867f-68249f853b8f'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:08:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8.5299ae4d-8aec-4888-b793-257ed892203f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:27 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-fd614cc6-c008-43ac-a3b7-4aed8cf9b743 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Delete snapshot completed successfully.
Sep 10 12:08:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8.5299ae4d-8aec-4888-b793-257ed892203f" returned: 0 in 0.675s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3797444-8854-450d-ae33-461ba65fc5d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 12:08:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8 {{(pid=82594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 10 12:08:27 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Creating direct copy from snapshot {{(pid=82594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 10 12:08:27 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-fd614cc6-c008-43ac-a3b7-4aed8cf9b743 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-af3e155e-4e6f-45f5-b04b-49798c6d0530-delete_snapshot" released by "delete_snapshot" :: held 5.621s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:27 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2bdc1a-ae5f-4a38-858e-369842715d84]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:08:27 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:28 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e9c03db7-e063-40bb-9864-279e961df7d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "cinder-7c1d7b14-3f95-4557-ba47-cea9de3710a2-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8" returned: 0 in 0.911s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:28 devstack cinder-volume[82594]: DEBUG cinder.utils [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316 not found in is_blk_device check {{(pid=82594) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 10 12:08:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:28 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root
Sep 10 12:08:28 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e9c03db7-e063-40bb-9864-279e961df7d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-7c1d7b14-3f95-4557-ba47-cea9de3710a2-delete_volume" acquired by "delete_volume" :: waited 0.359s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:28 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=162, name=volume-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:08:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_a1prslfudevstack@QuobyteHD" returned: 0 in 3.485s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_a1prslfudevstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:30 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-e9c03db7-e063-40bb-9864-279e961df7d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:08:30 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e9c03db7-e063-40bb-9864-279e961df7d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "cinder-quobyte-7c1d7b14-3f95-4557-ba47-cea9de3710a2" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:31 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e9c03db7-e063-40bb-9864-279e961df7d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-quobyte-7c1d7b14-3f95-4557-ba47-cea9de3710a2" acquired by "delete_volume" :: waited 0.372s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:31 devstack sudo[99757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_a1prslfudevstack@QuobyteHD
Sep 10 12:08:31 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 12:08:31 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2678f0ab-9bb1-47af-a5d2-fc005f9bf10d]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:08:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e9c03db7-e063-40bb-9864-279e961df7d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:33 devstack quobyte-client[82616]: System call of process 99767 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:08:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e9c03db7-e063-40bb-9864-279e961df7d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2" returned: 0 in 2.463s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e9c03db7-e063-40bb-9864-279e961df7d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e9c03db7-e063-40bb-9864-279e961df7d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-7c1d7b14-3f95-4557-ba47-cea9de3710a2" returned: 0 in 1.024s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:36 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e9c03db7-e063-40bb-9864-279e961df7d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-quobyte-7c1d7b14-3f95-4557-ba47-cea9de3710a2" released by "delete_volume" :: held 5.046s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:37 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:UPDATE=113,cinder:SELECT=78,cinder:DELETE=12,cinder:INSERT=24 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 12:08:37 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=72,cinder:UPDATE=114,cinder:DELETE=12,cinder:INSERT=20 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 12:08:38 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-e9c03db7-e063-40bb-9864-279e961df7d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Created reservations ['6eb21aaf-aaa6-41c0-9d85-f0fcefb78211', 'd4b6bfa3-73cf-4648-8d93-cd09fa8a476d', 'c745af6e-5d97-42b8-a979-d9c6fe3524b1', '7403859c-8402-4d46-b1c5-ebde0be6d387'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:08:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e9c03db7-e063-40bb-9864-279e961df7d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e9c03db7-e063-40bb-9864-279e961df7d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:39 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e9c03db7-e063-40bb-9864-279e961df7d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:08:39 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e9c03db7-e063-40bb-9864-279e961df7d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:08:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e9c03db7-e063-40bb-9864-279e961df7d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e9c03db7-e063-40bb-9864-279e961df7d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316" returned: 0 in 10.609s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:39 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c1d0da-c9cb-4cdb-84e0-8f982bd824f8]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:08:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:39 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root
Sep 10 12:08:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_a1prslfudevstack@QuobyteHD" returned: 1 in 10.448s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_a1prslfudevstack@QuobyteHD' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 12:08:39 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Temporary image df44ed4e-b7a1-4776-9bfd-cdf0700d6285 is fetched for user 78c31fff7c4d42cb8083f06c3a44f583. {{(pid=82594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 12:08:39 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e9c03db7-e063-40bb-9864-279e961df7d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.722s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:39 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-e9c03db7-e063-40bb-9864-279e961df7d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:08:40 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-e9c03db7-e063-40bb-9864-279e961df7d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Deleted volume successfully.
Sep 10 12:08:40 devstack quobyte-client[82616]: System call of process 99782 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:08:40 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e9c03db7-e063-40bb-9864-279e961df7d4 tempest-CreateVolumesFromSnapshotTest-1990013727 None] Lock "cinder-7c1d7b14-3f95-4557-ba47-cea9de3710a2-delete_volume" released by "delete_volume" :: held 11.678s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:40 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf33c4ac-5815-446f-8149-754c00abd6d4]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:08:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_a1prslfudevstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8" returned: 0 in 1.349s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:40 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Image conversion details: src /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8, size 1024.00 MB, duration 10.67 sec, destination /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316 {{(pid=82594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 12:08:40 devstack cinder-volume[82594]: INFO cinder.image.image_utils [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Converted 1024.00 MB image at 95.93 MB/s
Sep 10 12:08:40 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316 is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 12:08:40 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316" returned: 0 in 0.140s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:41 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Lock "cinder-quobyte-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316" released by "_copy_volume_from_snapshot" :: held 14.227s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:41 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Lock "cinder-quobyte-5299ae4d-8aec-4888-b793-257ed892203f-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316" released by "_create_volume_from_snapshot" :: held 14.291s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:41 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.337s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:41 devstack sudo[99784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_a1prslfudevstack@QuobyteHD
Sep 10 12:08:41 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 12:08:41 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (992dbc53-bea7-466d-a98b-92ca7e91d71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316', 'volume_size': 1, 'snapshot_id': '5299ae4d-8aec-4888-b793-257ed892203f'}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:41 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839e6f14-68f4-4f27-978c-691d2dca3559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:41 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Volume volume-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316 (c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316): created successfully
Sep 10 12:08:41 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839e6f14-68f4-4f27-978c-691d2dca3559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:41 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Flow 'volume_create_manager' (ec094148-f46d-4a00-b8f1-d1bac68f94cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:08:41 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-1e7d8eba-96e5-49eb-810a-bba4e869f794 tempest-SnapshotDependencyTests-1076138028 None] Created volume successfully.
Sep 10 12:08:43 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-3a8324af-c042-47cb-ab54-716dddfc289e tempest-SnapshotDependencyTests-1076138028 None] Acquiring lock "cinder-5299ae4d-8aec-4888-b793-257ed892203f-delete_snapshot" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:43 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-3a8324af-c042-47cb-ab54-716dddfc289e tempest-SnapshotDependencyTests-1076138028 None] Lock "cinder-5299ae4d-8aec-4888-b793-257ed892203f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:43 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-3a8324af-c042-47cb-ab54-716dddfc289e tempest-SnapshotDependencyTests-1076138028 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:08:43 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-3a8324af-c042-47cb-ab54-716dddfc289e tempest-SnapshotDependencyTests-1076138028 None] Acquiring lock "cinder-quobyte-c3797444-8854-450d-ae33-461ba65fc5d8" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:43 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-3a8324af-c042-47cb-ab54-716dddfc289e tempest-SnapshotDependencyTests-1076138028 None] Lock "cinder-quobyte-c3797444-8854-450d-ae33-461ba65fc5d8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:43 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-3a8324af-c042-47cb-ab54-716dddfc289e tempest-SnapshotDependencyTests-1076138028 None] Acquiring lock "cinder-quobyte-5299ae4d-8aec-4888-b793-257ed892203f" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:43 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-3a8324af-c042-47cb-ab54-716dddfc289e tempest-SnapshotDependencyTests-1076138028 None] Lock "cinder-quobyte-5299ae4d-8aec-4888-b793-257ed892203f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:43 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-3a8324af-c042-47cb-ab54-716dddfc289e tempest-SnapshotDependencyTests-1076138028 None] Deleting offline snapshot 5299ae4d-8aec-4888-b793-257ed892203f of volume c3797444-8854-450d-ae33-461ba65fc5d8 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 12:08:43 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-3a8324af-c042-47cb-ab54-716dddfc289e tempest-SnapshotDependencyTests-1076138028 None] snapshot_file for this snap is: volume-c3797444-8854-450d-ae33-461ba65fc5d8.5299ae4d-8aec-4888-b793-257ed892203f {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 12:08:43 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7e7e25-65c0-4d1a-a2eb-45e442a91f38]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:08:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-3a8324af-c042-47cb-ab54-716dddfc289e tempest-SnapshotDependencyTests-1076138028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8.5299ae4d-8aec-4888-b793-257ed892203f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:43 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root
Sep 10 12:08:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_a1prslfudevstack@QuobyteHD" returned: 0 in 3.154s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:43 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_a1prslfudevstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-3a8324af-c042-47cb-ab54-716dddfc289e tempest-SnapshotDependencyTests-1076138028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8.5299ae4d-8aec-4888-b793-257ed892203f" returned: 0 in 0.779s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:44 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-3a8324af-c042-47cb-ab54-716dddfc289e tempest-SnapshotDependencyTests-1076138028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3797444-8854-450d-ae33-461ba65fc5d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 12:08:44 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5289e6cc-b3c3-49fd-a00e-5ef10cbcbc53]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:08:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-3a8324af-c042-47cb-ab54-716dddfc289e tempest-SnapshotDependencyTests-1076138028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:44 devstack sudo[99792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_a1prslfudevstack@QuobyteHD
Sep 10 12:08:44 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 12:08:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-3a8324af-c042-47cb-ab54-716dddfc289e tempest-SnapshotDependencyTests-1076138028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8" returned: 0 in 0.633s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:44 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-3a8324af-c042-47cb-ab54-716dddfc289e tempest-SnapshotDependencyTests-1076138028 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8.5299ae4d-8aec-4888-b793-257ed892203f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-3a8324af-c042-47cb-ab54-716dddfc289e tempest-SnapshotDependencyTests-1076138028 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8.5299ae4d-8aec-4888-b793-257ed892203f" returned: 0 in 0.426s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-3a8324af-c042-47cb-ab54-716dddfc289e tempest-SnapshotDependencyTests-1076138028 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8.5299ae4d-8aec-4888-b793-257ed892203f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:45 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-3a8324af-c042-47cb-ab54-716dddfc289e tempest-SnapshotDependencyTests-1076138028 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8.5299ae4d-8aec-4888-b793-257ed892203f" returned: 0 in 0.244s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:45 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-3a8324af-c042-47cb-ab54-716dddfc289e tempest-SnapshotDependencyTests-1076138028 None] Lock "cinder-quobyte-5299ae4d-8aec-4888-b793-257ed892203f" released by "_delete_snapshot" :: held 2.471s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:45 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-3a8324af-c042-47cb-ab54-716dddfc289e tempest-SnapshotDependencyTests-1076138028 None] Lock "cinder-quobyte-c3797444-8854-450d-ae33-461ba65fc5d8" released by "delete_snapshot" :: held 2.502s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:46 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:08:46 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:08:46 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Flow 'volume_create_manager' (78cd9bfe-4697-4db3-99a7-0317631c8e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:08:46 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f69c309-ea58-49de-9d6e-531dae385557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:46 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f69c309-ea58-49de-9d6e-531dae385557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-857753525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fae2e8a-d717-46b2-a4b4-662938c521b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf7fe653f724665852245557f905361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:08:46Z,use_quota=True,user_id='e9f328b01a4040379fb0e0f8b3695e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:46 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e847fd0f-960d-41a0-8328-6efe151a19b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:46 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e847fd0f-960d-41a0-8328-6efe151a19b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:46 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9539623-604b-4925-bb0c-5a216ac28fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:46 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9539623-604b-4925-bb0c-5a216ac28fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fae2e8a-d717-46b2-a4b4-662938c521b1', 'volume_name': 'volume-6fae2e8a-d717-46b2-a4b4-662938c521b1', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:46 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19177a7-a1b6-4e95-ba1a-9b1cad170d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:46 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19177a7-a1b6-4e95-ba1a-9b1cad170d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:46 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d74324-08a6-4320-bdb3-429d7df030fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:46 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume 6fae2e8a-d717-46b2-a4b4-662938c521b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fae2e8a-d717-46b2-a4b4-662938c521b1', 'volume_size': 1}
Sep 10 12:08:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:46 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-857753525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fae2e8a-d717-46b2-a4b4-662938c521b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf7fe653f724665852245557f905361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:08:46Z,use_quota=True,user_id='e9f328b01a4040379fb0e0f8b3695e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:08:46 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Creating volume 6fae2e8a-d717-46b2-a4b4-662938c521b1 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:08:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:46 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:08:46 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:08:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:46 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:08:46 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:08:46 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6fae2e8a-d717-46b2-a4b4-662938c521b1 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:46 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-3a8324af-c042-47cb-ab54-716dddfc289e tempest-SnapshotDependencyTests-1076138028 None] Created reservations ['39caa115-f25b-448c-b4b6-daf0b822a5ab', '8ba5ecfd-4fd2-464f-8711-2d64117608c3', 'e6469397-89ae-41c0-9aae-7c8343aba567', 'cbddc425-51c2-410f-bf64-6bab2aa16c0d'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:08:46 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=163, name=volume-6fae2e8a-d717-46b2-a4b4-662938c521b1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:08:47 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root
Sep 10 12:08:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_a1prslfudevstack@QuobyteHD" returned: 1 in 3.314s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_a1prslfudevstack@QuobyteHD' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 12:08:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6fae2e8a-d717-46b2-a4b4-662938c521b1 1073741824" returned: 0 in 0.626s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6fae2e8a-d717-46b2-a4b4-662938c521b1 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:47 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-3a8324af-c042-47cb-ab54-716dddfc289e tempest-SnapshotDependencyTests-1076138028 None] Delete snapshot completed successfully.
Sep 10 12:08:47 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-3a8324af-c042-47cb-ab54-716dddfc289e tempest-SnapshotDependencyTests-1076138028 None] Lock "cinder-5299ae4d-8aec-4888-b793-257ed892203f-delete_snapshot" released by "delete_snapshot" :: held 4.299s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6fae2e8a-d717-46b2-a4b4-662938c521b1" returned: 0 in 0.285s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:47 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] <== create_volume: return (940ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:08:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.643s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:47 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=986bd2ea-b707-43fa-bdfa-592545e528d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d178b46b4fae400a8d4b05207869f12a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:08:22Z,use_quota=True,user_id='78c31fff7c4d42cb8083f06c3a44f583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:08:47 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Creating volume 986bd2ea-b707-43fa-bdfa-592545e528d7 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:08:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:47 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:08:47 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:08:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:47 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:08:47 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:08:47 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-986bd2ea-b707-43fa-bdfa-592545e528d7 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:47 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-3da7b230-7a3c-4f9a-aba7-12c0914289ba tempest-SnapshotDependencyTests-1076138028 None] Acquiring lock "cinder-c3797444-8854-450d-ae33-461ba65fc5d8-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:48 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=164, name=volume-986bd2ea-b707-43fa-bdfa-592545e528d7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:08:48 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d74324-08a6-4320-bdb3-429d7df030fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fae2e8a-d717-46b2-a4b4-662938c521b1', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:48 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8676df52-fc11-455c-867e-b6f3bbee7bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-986bd2ea-b707-43fa-bdfa-592545e528d7 1073741824" returned: 0 in 0.529s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-986bd2ea-b707-43fa-bdfa-592545e528d7 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:48 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-3da7b230-7a3c-4f9a-aba7-12c0914289ba tempest-SnapshotDependencyTests-1076138028 None] Lock "cinder-c3797444-8854-450d-ae33-461ba65fc5d8-delete_volume" acquired by "delete_volume" :: waited 0.525s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:48 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume volume-6fae2e8a-d717-46b2-a4b4-662938c521b1 (6fae2e8a-d717-46b2-a4b4-662938c521b1): created successfully
Sep 10 12:08:48 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8676df52-fc11-455c-867e-b6f3bbee7bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:48 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Flow 'volume_create_manager' (78cd9bfe-4697-4db3-99a7-0317631c8e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:08:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-986bd2ea-b707-43fa-bdfa-592545e528d7" returned: 0 in 0.410s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:48 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] <== create_volume: return (962ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:08:48 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:48 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-0a512b03-20e4-4f9c-8d1e-2361853c2a84 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Created volume successfully.
Sep 10 12:08:48 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-3da7b230-7a3c-4f9a-aba7-12c0914289ba tempest-SnapshotDependencyTests-1076138028 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:08:48 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-3da7b230-7a3c-4f9a-aba7-12c0914289ba tempest-SnapshotDependencyTests-1076138028 None] Acquiring lock "cinder-quobyte-c3797444-8854-450d-ae33-461ba65fc5d8" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:48 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-3da7b230-7a3c-4f9a-aba7-12c0914289ba tempest-SnapshotDependencyTests-1076138028 None] Lock "cinder-quobyte-c3797444-8854-450d-ae33-461ba65fc5d8" acquired by "delete_volume" :: waited 0.051s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:48 devstack cinder-volume[82594]: DEBUG cinder.volume.volume_utils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Attempting download of df44ed4e-b7a1-4776-9bfd-cdf0700d6285 ((None, None)) to volume 986bd2ea-b707-43fa-bdfa-592545e528d7. {{(pid=82594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 12:08:49 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[787b4af0-6897-48be-95c7-13f454508dc4]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:08:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-3da7b230-7a3c-4f9a-aba7-12c0914289ba tempest-SnapshotDependencyTests-1076138028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:49 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef16e26-6df5-49f1-8635-647f630d04c0]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:08:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_qs5p4ko_ {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-3da7b230-7a3c-4f9a-aba7-12c0914289ba tempest-SnapshotDependencyTests-1076138028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8" returned: 0 in 0.725s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:49 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-3da7b230-7a3c-4f9a-aba7-12c0914289ba tempest-SnapshotDependencyTests-1076138028 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-3da7b230-7a3c-4f9a-aba7-12c0914289ba tempest-SnapshotDependencyTests-1076138028 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c3797444-8854-450d-ae33-461ba65fc5d8" returned: 0 in 0.647s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_qs5p4ko_" returned: 0 in 1.055s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:50 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_qs5p4ko_ {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:50 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Flow 'volume_create_manager' (5ea3ea20-5f3e-4c8b-9d4f-54d8e3efe0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0c564d-f7a6-4250-9f01-cf68063d014f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-3da7b230-7a3c-4f9a-aba7-12c0914289ba tempest-SnapshotDependencyTests-1076138028 None] Lock "cinder-quobyte-c3797444-8854-450d-ae33-461ba65fc5d8" released by "delete_volume" :: held 2.331s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:51 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Flow 'volume_create_manager' (4a156fd8-c1d7-434f-afbb-f65a11949554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7dcab5-af9e-4097-89af-8345e6a946b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7dcab5-af9e-4097-89af-8345e6a946b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-577323602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9543f593-9a54-4979-8c85-8ed93b1bc5b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf7fe653f724665852245557f905361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:08:51Z,use_quota=True,user_id='e9f328b01a4040379fb0e0f8b3695e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7581ee12-3bd3-49a2-be8d-18daecd3fcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7581ee12-3bd3-49a2-be8d-18daecd3fcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcbe14ea-4f87-4849-a4c1-cb7d8301d254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcbe14ea-4f87-4849-a4c1-cb7d8301d254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9543f593-9a54-4979-8c85-8ed93b1bc5b5', 'volume_name': 'volume-9543f593-9a54-4979-8c85-8ed93b1bc5b5', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ac22ca-8a4d-4319-9a21-ef50b73698d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ac22ca-8a4d-4319-9a21-ef50b73698d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (485947fb-4c34-4f66-8334-7aa57a01dd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:51 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume 9543f593-9a54-4979-8c85-8ed93b1bc5b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9543f593-9a54-4979-8c85-8ed93b1bc5b5', 'volume_size': 1}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-577323602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9543f593-9a54-4979-8c85-8ed93b1bc5b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf7fe653f724665852245557f905361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:08:51Z,use_quota=True,user_id='e9f328b01a4040379fb0e0f8b3695e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Creating volume 9543f593-9a54-4979-8c85-8ed93b1bc5b5 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:08:51 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9543f593-9a54-4979-8c85-8ed93b1bc5b5 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:51 devstack quobyte-client[82616]: System call of process 99822 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:08:51 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=165, name=volume-9543f593-9a54-4979-8c85-8ed93b1bc5b5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0c564d-f7a6-4250-9f01-cf68063d014f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-625969432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a4478cc-2b0d-4272-94f9-bd79f149379d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf7fe653f724665852245557f905361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:08:50Z,use_quota=True,user_id='e9f328b01a4040379fb0e0f8b3695e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84052d4-2afb-45e1-b2a1-f1b9bed60f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84052d4-2afb-45e1-b2a1-f1b9bed60f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b91a546-6a89-49d8-90c6-159b1fcb68ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:51 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b91a546-6a89-49d8-90c6-159b1fcb68ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a4478cc-2b0d-4272-94f9-bd79f149379d', 'volume_name': 'volume-3a4478cc-2b0d-4272-94f9-bd79f149379d', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b77a1b0-e475-42c1-92de-1f88e950b45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b77a1b0-e475-42c1-92de-1f88e950b45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a12da3-bba4-4ac4-9566-a4b20db39c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:52 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume 3a4478cc-2b0d-4272-94f9-bd79f149379d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a4478cc-2b0d-4272-94f9-bd79f149379d', 'volume_size': 1}
Sep 10 12:08:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_qs5p4ko_" returned: 1 in 1.565s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_qs5p4ko_' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 12:08:52 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88a95e8-cd77-4c6d-a02b-887be1b05609]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:08:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_a1prslfudevstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9543f593-9a54-4979-8c85-8ed93b1bc5b5 1073741824" returned: 0 in 1.102s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:52 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:08:52 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:08:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Flow 'volume_create_manager' (c47dfaca-2cec-4fc9-bbb8-0612e1346eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:08:52 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (784d847d-b95b-4f60-9b6b-43c58b4119cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:52 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9543f593-9a54-4979-8c85-8ed93b1bc5b5 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-3da7b230-7a3c-4f9a-aba7-12c0914289ba tempest-SnapshotDependencyTests-1076138028 None] Created reservations ['724e21a9-1c80-4d24-a2fd-7d2ef14e2ee0', 'ad1a7f54-9de8-483b-a599-91f6870f8913', 'b6d8b0e5-eb88-4087-b4ed-be1526766909', '6cc5d929-de13-482e-a2eb-dfd813cd16e3'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:08:53 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Flow 'volume_create_manager' (ef74f840-4ff4-44b7-bb65-82d5c3a4199f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef55ec6-f0a8-4fff-959d-95413ce38cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (784d847d-b95b-4f60-9b6b-43c58b4119cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-439779458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4519ade-3534-4db0-908f-eb253ac82ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf7fe653f724665852245557f905361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:08:51Z,use_quota=True,user_id='e9f328b01a4040379fb0e0f8b3695e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a7725b-fc48-4aaa-ab43-de8788cfcc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a7725b-fc48-4aaa-ab43-de8788cfcc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c2b789-3626-4bc4-9c29-1ed85cae023a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c2b789-3626-4bc4-9c29-1ed85cae023a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4519ade-3534-4db0-908f-eb253ac82ca5', 'volume_name': 'volume-e4519ade-3534-4db0-908f-eb253ac82ca5', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0230f425-9af5-4cb9-8685-297aff1d651d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0230f425-9af5-4cb9-8685-297aff1d651d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb06640-d8da-4b53-84a7-ed3d368f2836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:53 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume e4519ade-3534-4db0-908f-eb253ac82ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4519ade-3534-4db0-908f-eb253ac82ca5', 'volume_size': 1}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_a1prslfudevstack@QuobyteHD" returned: 0 in 1.303s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9543f593-9a54-4979-8c85-8ed93b1bc5b5" returned: 0 in 0.677s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_a1prslfudevstack@QuobyteHD {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef55ec6-f0a8-4fff-959d-95413ce38cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1927403393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04583e58-71db-46a4-ac4d-df125d99f279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf7fe653f724665852245557f905361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:08:52Z,use_quota=True,user_id='e9f328b01a4040379fb0e0f8b3695e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e045ea-e679-4a34-abfc-f22d506a4f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e045ea-e679-4a34-abfc-f22d506a4f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca176832-57d8-4399-8cd2-dce50aba2775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca176832-57d8-4399-8cd2-dce50aba2775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04583e58-71db-46a4-ac4d-df125d99f279', 'volume_name': 'volume-04583e58-71db-46a4-ac4d-df125d99f279', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da036c4-71fa-4869-9f60-7ee70e8cc15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da036c4-71fa-4869-9f60-7ee70e8cc15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edfbdceb-92b9-4511-baf4-4c520f00700b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:53 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume 04583e58-71db-46a4-ac4d-df125d99f279: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04583e58-71db-46a4-ac4d-df125d99f279', 'volume_size': 1}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] <== create_volume: return (2339ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.349s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.946s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-625969432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a4478cc-2b0d-4272-94f9-bd79f149379d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf7fe653f724665852245557f905361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:08:50Z,use_quota=True,user_id='e9f328b01a4040379fb0e0f8b3695e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Creating volume 3a4478cc-2b0d-4272-94f9-bd79f149379d {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:08:53 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:08:53 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3a4478cc-2b0d-4272-94f9-bd79f149379d 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:54 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f427aca2-9080-4315-a420-424271b61ec2 tempest-SnapshotDependencyTests-1076138028 None] Acquiring lock "cinder-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:54 devstack quobyte-client[82616]: System call of process 99830 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:08:54 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=166, name=volume-3a4478cc-2b0d-4272-94f9-bd79f149379d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:08:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-3da7b230-7a3c-4f9a-aba7-12c0914289ba tempest-SnapshotDependencyTests-1076138028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-3da7b230-7a3c-4f9a-aba7-12c0914289ba tempest-SnapshotDependencyTests-1076138028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:54 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-3da7b230-7a3c-4f9a-aba7-12c0914289ba tempest-SnapshotDependencyTests-1076138028 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:08:54 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-3da7b230-7a3c-4f9a-aba7-12c0914289ba tempest-SnapshotDependencyTests-1076138028 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:08:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-3da7b230-7a3c-4f9a-aba7-12c0914289ba tempest-SnapshotDependencyTests-1076138028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-3da7b230-7a3c-4f9a-aba7-12c0914289ba tempest-SnapshotDependencyTests-1076138028 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:54 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:08:54 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:08:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Flow 'volume_create_manager' (9a9e9851-857d-4963-b67f-095cbfd74842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:08:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044be2f1-19f4-499a-9628-3c5f12e9330f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (485947fb-4c34-4f66-8334-7aa57a01dd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9543f593-9a54-4979-8c85-8ed93b1bc5b5', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd9ad03-dd98-439f-8fc6-d3abcd6710f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_a1prslfudevstack@QuobyteHD" returned: 1 in 1.440s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:54 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_a1prslfudevstack@QuobyteHD' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 12:08:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044be2f1-19f4-499a-9628-3c5f12e9330f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-510946501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9f84e6c-b152-499d-a9d1-22ff0a8ea502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf7fe653f724665852245557f905361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:08:52Z,use_quota=True,user_id='e9f328b01a4040379fb0e0f8b3695e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4ffeb9-2bb9-477a-a31b-e53e2a9b5907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4ffeb9-2bb9-477a-a31b-e53e2a9b5907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d4e5e74-5419-4e12-a5a6-939b6ea9bc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d4e5e74-5419-4e12-a5a6-939b6ea9bc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9f84e6c-b152-499d-a9d1-22ff0a8ea502', 'volume_name': 'volume-f9f84e6c-b152-499d-a9d1-22ff0a8ea502', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f945caf-e4b2-44fa-94c7-654c331923da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f945caf-e4b2-44fa-94c7-654c331923da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:54 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f193dd6-919b-4036-88bb-c7b28d3a3971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:55 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume f9f84e6c-b152-499d-a9d1-22ff0a8ea502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9f84e6c-b152-499d-a9d1-22ff0a8ea502', 'volume_size': 1}
Sep 10 12:08:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:55 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] df44ed4e-b7a1-4776-9bfd-cdf0700d6285 was raw, converting to raw {{(pid=82594) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 12:08:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_a1prslfudevstack@QuobyteHD /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-986bd2ea-b707-43fa-bdfa-592545e528d7 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:55 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f427aca2-9080-4315-a420-424271b61ec2 tempest-SnapshotDependencyTests-1076138028 None] Lock "cinder-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316-delete_volume" acquired by "delete_volume" :: waited 0.976s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:55 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=164, name=volume-986bd2ea-b707-43fa-bdfa-592545e528d7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:08:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3a4478cc-2b0d-4272-94f9-bd79f149379d 1073741824" returned: 0 in 1.273s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3a4478cc-2b0d-4272-94f9-bd79f149379d {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-3da7b230-7a3c-4f9a-aba7-12c0914289ba tempest-SnapshotDependencyTests-1076138028 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 1.096s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:55 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume volume-9543f593-9a54-4979-8c85-8ed93b1bc5b5 (9543f593-9a54-4979-8c85-8ed93b1bc5b5): created successfully
Sep 10 12:08:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd9ad03-dd98-439f-8fc6-d3abcd6710f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:55 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Flow 'volume_create_manager' (4a156fd8-c1d7-434f-afbb-f65a11949554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:08:55 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-3da7b230-7a3c-4f9a-aba7-12c0914289ba tempest-SnapshotDependencyTests-1076138028 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:08:55 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-3da7b230-7a3c-4f9a-aba7-12c0914289ba tempest-SnapshotDependencyTests-1076138028 None] Deleted volume successfully.
Sep 10 12:08:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_a1prslfudevstack@QuobyteHD /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-986bd2ea-b707-43fa-bdfa-592545e528d7" returned: 0 in 0.744s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:55 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_df44ed4e-b7a1-4776-9bfd-cdf0700d6285_a1prslfudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-986bd2ea-b707-43fa-bdfa-592545e528d7 {{(pid=82594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 12:08:55 devstack cinder-volume[82594]: INFO cinder.image.image_utils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Converted 0.00 MB image at 0.00 MB/s
Sep 10 12:08:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-986bd2ea-b707-43fa-bdfa-592545e528d7 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:55 devstack quobyte-client[82616]: System call of process 99840 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:08:55 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3a4478cc-2b0d-4272-94f9-bd79f149379d" returned: 0 in 0.639s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:56 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] <== create_volume: return (2178ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:08:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.189s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:56 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-63c299d6-9abd-438d-aba9-b744c8181f4b tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Created volume successfully.
Sep 10 12:08:56 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-f427aca2-9080-4315-a420-424271b61ec2 tempest-SnapshotDependencyTests-1076138028 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:08:56 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f427aca2-9080-4315-a420-424271b61ec2 tempest-SnapshotDependencyTests-1076138028 None] Acquiring lock "cinder-quobyte-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:08:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.800s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:56 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-439779458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4519ade-3534-4db0-908f-eb253ac82ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf7fe653f724665852245557f905361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:08:51Z,use_quota=True,user_id='e9f328b01a4040379fb0e0f8b3695e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:08:56 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Creating volume e4519ade-3534-4db0-908f-eb253ac82ca5 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:08:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:56 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:08:56 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:08:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:56 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:08:56 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:08:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e4519ade-3534-4db0-908f-eb253ac82ca5 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:56 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=167, name=volume-e4519ade-3534-4db0-908f-eb253ac82ca5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:08:56 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a12da3-bba4-4ac4-9566-a4b20db39c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a4478cc-2b0d-4272-94f9-bd79f149379d', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:56 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176129ca-bf84-43cf-824a-e715255d5a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:56 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume volume-3a4478cc-2b0d-4272-94f9-bd79f149379d (3a4478cc-2b0d-4272-94f9-bd79f149379d): created successfully
Sep 10 12:08:56 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176129ca-bf84-43cf-824a-e715255d5a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:56 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Flow 'volume_create_manager' (5ea3ea20-5f3e-4c8b-9d4f-54d8e3efe0cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:08:56 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-3da7b230-7a3c-4f9a-aba7-12c0914289ba tempest-SnapshotDependencyTests-1076138028 None] Lock "cinder-c3797444-8854-450d-ae33-461ba65fc5d8-delete_volume" released by "delete_volume" :: held 8.328s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-986bd2ea-b707-43fa-bdfa-592545e528d7 1G" returned: 0 in 1.070s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:56 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f427aca2-9080-4315-a420-424271b61ec2 tempest-SnapshotDependencyTests-1076138028 None] Lock "cinder-quobyte-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316" acquired by "delete_volume" :: waited 0.660s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:08:56 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-ea140911-5de6-43a5-a179-9987866379ab tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Created volume successfully.
Sep 10 12:08:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e4519ade-3534-4db0-908f-eb253ac82ca5 1073741824" returned: 0 in 0.667s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:56 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e4519ade-3534-4db0-908f-eb253ac82ca5 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:57 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ec5b25-9448-4d16-aab3-d109423610b0]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:08:57 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c48b5f-45d0-4a0a-8ba8-2a07a1e012f9]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:08:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f427aca2-9080-4315-a420-424271b61ec2 tempest-SnapshotDependencyTests-1076138028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-986bd2ea-b707-43fa-bdfa-592545e528d7 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e4519ade-3534-4db0-908f-eb253ac82ca5" returned: 0 in 0.510s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] <== create_volume: return (1229ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:08:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.821s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1927403393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04583e58-71db-46a4-ac4d-df125d99f279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf7fe653f724665852245557f905361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:08:52Z,use_quota=True,user_id='e9f328b01a4040379fb0e0f8b3695e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:08:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Creating volume 04583e58-71db-46a4-ac4d-df125d99f279 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:08:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:08:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:08:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:57 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:08:57 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:08:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-04583e58-71db-46a4-ac4d-df125d99f279 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:57 devstack quobyte-client[82616]: System call of process 99847 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:08:57 devstack quobyte-client[82616]: System call of process 99849 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:08:57 devstack quobyte-client[82616]: System call of process 99849 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:08:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f427aca2-9080-4315-a420-424271b61ec2 tempest-SnapshotDependencyTests-1076138028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316" returned: 0 in 0.769s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:57 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f427aca2-9080-4315-a420-424271b61ec2 tempest-SnapshotDependencyTests-1076138028 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:57 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=168, name=volume-04583e58-71db-46a4-ac4d-df125d99f279, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:08:58 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb06640-d8da-4b53-84a7-ed3d368f2836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4519ade-3534-4db0-908f-eb253ac82ca5', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:58 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb01993-0712-4b47-b9df-ebd2c32f1b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-04583e58-71db-46a4-ac4d-df125d99f279 1073741824" returned: 0 in 0.773s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f427aca2-9080-4315-a420-424271b61ec2 tempest-SnapshotDependencyTests-1076138028 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316" returned: 0 in 0.500s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-04583e58-71db-46a4-ac4d-df125d99f279 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-986bd2ea-b707-43fa-bdfa-592545e528d7" returned: 0 in 1.370s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:58 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-986bd2ea-b707-43fa-bdfa-592545e528d7 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:58 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume volume-e4519ade-3534-4db0-908f-eb253ac82ca5 (e4519ade-3534-4db0-908f-eb253ac82ca5): created successfully
Sep 10 12:08:58 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb01993-0712-4b47-b9df-ebd2c32f1b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:58 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Flow 'volume_create_manager' (c47dfaca-2cec-4fc9-bbb8-0612e1346eda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:08:59 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f427aca2-9080-4315-a420-424271b61ec2 tempest-SnapshotDependencyTests-1076138028 None] Lock "cinder-quobyte-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316" released by "delete_volume" :: held 2.134s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:08:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-04583e58-71db-46a4-ac4d-df125d99f279" returned: 0 in 0.679s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] <== create_volume: return (1489ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:08:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:59 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-618da695-b95a-4add-bee5-008d0c2fde80 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Created volume successfully.
Sep 10 12:08:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.168s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-510946501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9f84e6c-b152-499d-a9d1-22ff0a8ea502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf7fe653f724665852245557f905361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:08:52Z,use_quota=True,user_id='e9f328b01a4040379fb0e0f8b3695e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:08:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Creating volume f9f84e6c-b152-499d-a9d1-22ff0a8ea502 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:08:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:08:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:08:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:08:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:08:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:08:59 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:08:59 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:08:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f9f84e6c-b152-499d-a9d1-22ff0a8ea502 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:59 devstack quobyte-client[82616]: System call of process 99860 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:08:59 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=169, name=volume-f9f84e6c-b152-499d-a9d1-22ff0a8ea502, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:08:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edfbdceb-92b9-4511-baf4-4c520f00700b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04583e58-71db-46a4-ac4d-df125d99f279', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:08:59 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f4e067-0e3c-44f7-a860-189a5cb2351b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:08:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-986bd2ea-b707-43fa-bdfa-592545e528d7" returned: 1 in 1.059s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-986bd2ea-b707-43fa-bdfa-592545e528d7' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 12:08:59 devstack cinder-volume[82594]: DEBUG cinder.volume.volume_utils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Downloaded image df44ed4e-b7a1-4776-9bfd-cdf0700d6285 ((None, None)) to volume 986bd2ea-b707-43fa-bdfa-592545e528d7 successfully. {{(pid=82594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 12:08:59 devstack cinder-volume[82594]: DEBUG cinder.image.image_utils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Temporary image df44ed4e-b7a1-4776-9bfd-cdf0700d6285 for user 78c31fff7c4d42cb8083f06c3a44f583 is deleted. {{(pid=82594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 12:08:59 devstack cinder-volume[82594]: DEBUG cinder.volume.volume_utils [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Marking volume 986bd2ea-b707-43fa-bdfa-592545e528d7 as bootable. {{(pid=82594) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 12:08:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f9f84e6c-b152-499d-a9d1-22ff0a8ea502 1073741824" returned: 0 in 0.538s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:08:59 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f9f84e6c-b152-499d-a9d1-22ff0a8ea502 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:08:59 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Copying metadata from image df44ed4e-b7a1-4776-9bfd-cdf0700d6285 to 986bd2ea-b707-43fa-bdfa-592545e528d7. {{(pid=82594) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 12:08:59 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Creating volume glance metadata for volume 986bd2ea-b707-43fa-bdfa-592545e528d7 backed by image df44ed4e-b7a1-4776-9bfd-cdf0700d6285 with: {'image_id': 'df44ed4e-b7a1-4776-9bfd-cdf0700d6285', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '623d3c697605c85d9109b0c14cf10b72', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=82594) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 12:09:00 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume volume-04583e58-71db-46a4-ac4d-df125d99f279 (04583e58-71db-46a4-ac4d-df125d99f279): created successfully
Sep 10 12:09:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f4e067-0e3c-44f7-a860-189a5cb2351b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:09:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Flow 'volume_create_manager' (ef74f840-4ff4-44b7-bb65-82d5c3a4199f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:09:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f9f84e6c-b152-499d-a9d1-22ff0a8ea502" returned: 0 in 0.408s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] <== create_volume: return (972ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:09:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:09:00 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-dfc39cc5-0ac6-4b3d-afdb-52d315d0ddf9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Created volume successfully.
Sep 10 12:09:00 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-f427aca2-9080-4315-a420-424271b61ec2 tempest-SnapshotDependencyTests-1076138028 None] Created reservations ['d4112462-eb70-42c8-9bd6-3ddfaef0b54a', '560699d2-7b48-458c-8e50-37805ff3223a', 'f8306824-9358-434c-85a5-3e46b4745d5b', '0f10cb5f-c9be-4a76-bed3-b26f5e8268ff'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:09:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f193dd6-919b-4036-88bb-c7b28d3a3971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9f84e6c-b152-499d-a9d1-22ff0a8ea502', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:09:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2247de39-f9f2-4ae3-aae2-ac48f4ca87ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:09:00 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume volume-f9f84e6c-b152-499d-a9d1-22ff0a8ea502 (f9f84e6c-b152-499d-a9d1-22ff0a8ea502): created successfully
Sep 10 12:09:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2247de39-f9f2-4ae3-aae2-ac48f4ca87ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:09:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Flow 'volume_create_manager' (9a9e9851-857d-4963-b67f-095cbfd74842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:09:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54360b58-f124-472d-b3e0-11b65400a52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-986bd2ea-b707-43fa-bdfa-592545e528d7', 'volume_size': 1, 'image_id': 'df44ed4e-b7a1-4776-9bfd-cdf0700d6285', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '623d3c697605c85d9109b0c14cf10b72', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd178b46b4fae400a8d4b05207869f12a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8277bd6d3c84c6af62cf2373d89ef6edc0c45abe4f7e52b71c8a9a44585f5e1a59651b96e6a6ebdfa82896179aeb1a933b360263d5f41f60c4159c847b68853f', 'id': 'df44ed4e-b7a1-4776-9bfd-cdf0700d6285', 'created_at': datetime.datetime(2025, 9, 10, 10, 8, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 10, 8, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df44ed4e-b7a1-4776-9bfd-cdf0700d6285/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4f51a80400>}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:09:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af6ed6c-f7b5-4741-b455-b40fd4b7ae96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:09:00 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-8a00eb5c-202f-40d0-84aa-8fd1037e4da2 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Created volume successfully.
Sep 10 12:09:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f427aca2-9080-4315-a420-424271b61ec2 tempest-SnapshotDependencyTests-1076138028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:09:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f427aca2-9080-4315-a420-424271b61ec2 tempest-SnapshotDependencyTests-1076138028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:09:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f427aca2-9080-4315-a420-424271b61ec2 tempest-SnapshotDependencyTests-1076138028 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:09:00 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f427aca2-9080-4315-a420-424271b61ec2 tempest-SnapshotDependencyTests-1076138028 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:09:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f427aca2-9080-4315-a420-424271b61ec2 tempest-SnapshotDependencyTests-1076138028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:09:00 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f427aca2-9080-4315-a420-424271b61ec2 tempest-SnapshotDependencyTests-1076138028 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:00 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Volume volume-986bd2ea-b707-43fa-bdfa-592545e528d7 (986bd2ea-b707-43fa-bdfa-592545e528d7): created successfully
Sep 10 12:09:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af6ed6c-f7b5-4741-b455-b40fd4b7ae96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:09:00 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Flow 'volume_create_manager' (10fe97a4-d41c-40ed-a7ea-2e3c1c4bbeb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:09:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e90beaf9-0cce-42c5-9bdb-2b5dd1cd4085 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "cinder-f9f84e6c-b152-499d-a9d1-22ff0a8ea502-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:09:01 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-fb701401-ce7b-4c1d-b1f1-1d22b9459e3b tempest-VolumeImageDependencyTests-151009898 None] Created volume successfully.
Sep 10 12:09:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f427aca2-9080-4315-a420-424271b61ec2 tempest-SnapshotDependencyTests-1076138028 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.646s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:01 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-f427aca2-9080-4315-a420-424271b61ec2 tempest-SnapshotDependencyTests-1076138028 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:09:01 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-f427aca2-9080-4315-a420-424271b61ec2 tempest-SnapshotDependencyTests-1076138028 None] Deleted volume successfully.
Sep 10 12:09:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e90beaf9-0cce-42c5-9bdb-2b5dd1cd4085 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "cinder-f9f84e6c-b152-499d-a9d1-22ff0a8ea502-delete_volume" acquired by "delete_volume" :: waited 0.134s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:09:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f427aca2-9080-4315-a420-424271b61ec2 tempest-SnapshotDependencyTests-1076138028 None] Lock "cinder-c85c7fc3-0dbb-40ab-b2fa-4eb52c2ac316-delete_volume" released by "delete_volume" :: held 6.145s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:09:01 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-e90beaf9-0cce-42c5-9bdb-2b5dd1cd4085 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:09:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e90beaf9-0cce-42c5-9bdb-2b5dd1cd4085 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "cinder-quobyte-f9f84e6c-b152-499d-a9d1-22ff0a8ea502" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:09:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e90beaf9-0cce-42c5-9bdb-2b5dd1cd4085 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "cinder-quobyte-f9f84e6c-b152-499d-a9d1-22ff0a8ea502" acquired by "delete_volume" :: waited 0.014s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:09:01 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d93d617-09d0-4ea9-890f-a70729a81828]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:09:01 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e90beaf9-0cce-42c5-9bdb-2b5dd1cd4085 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f9f84e6c-b152-499d-a9d1-22ff0a8ea502 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b52753b1-4ab1-4a36-bee8-5da195f870f7 tempest-VolumeImageDependencyTests-151009898 None] Acquiring lock "cinder-986bd2ea-b707-43fa-bdfa-592545e528d7-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:09:01 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b52753b1-4ab1-4a36-bee8-5da195f870f7 tempest-VolumeImageDependencyTests-151009898 None] Lock "cinder-986bd2ea-b707-43fa-bdfa-592545e528d7-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:09:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e90beaf9-0cce-42c5-9bdb-2b5dd1cd4085 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f9f84e6c-b152-499d-a9d1-22ff0a8ea502" returned: 0 in 0.645s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e90beaf9-0cce-42c5-9bdb-2b5dd1cd4085 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f9f84e6c-b152-499d-a9d1-22ff0a8ea502 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:02 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-b52753b1-4ab1-4a36-bee8-5da195f870f7 tempest-VolumeImageDependencyTests-151009898 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:09:02 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b52753b1-4ab1-4a36-bee8-5da195f870f7 tempest-VolumeImageDependencyTests-151009898 None] Acquiring lock "cinder-quobyte-986bd2ea-b707-43fa-bdfa-592545e528d7" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:09:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e90beaf9-0cce-42c5-9bdb-2b5dd1cd4085 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-f9f84e6c-b152-499d-a9d1-22ff0a8ea502" returned: 0 in 0.554s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:02 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e90beaf9-0cce-42c5-9bdb-2b5dd1cd4085 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "cinder-quobyte-f9f84e6c-b152-499d-a9d1-22ff0a8ea502" released by "delete_volume" :: held 1.275s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:09:02 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b52753b1-4ab1-4a36-bee8-5da195f870f7 tempest-VolumeImageDependencyTests-151009898 None] Lock "cinder-quobyte-986bd2ea-b707-43fa-bdfa-592545e528d7" acquired by "delete_volume" :: waited 0.086s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:09:02 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f277e8-bcec-46ce-808e-1d09da44b383]: (4, 'raw') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:09:02 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b52753b1-4ab1-4a36-bee8-5da195f870f7 tempest-VolumeImageDependencyTests-151009898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-986bd2ea-b707-43fa-bdfa-592545e528d7 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:03 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-e90beaf9-0cce-42c5-9bdb-2b5dd1cd4085 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Created reservations ['98bef6ec-0e55-494e-9c78-6c58853959e2', '7e13cbfe-3505-4dd5-970e-508c2433176e', 'fb4ef8e9-bc0e-443f-b98d-4876a1dc9160', 'b1612f16-9cab-43c4-8d0d-64dc77dbe05f'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:09:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b52753b1-4ab1-4a36-bee8-5da195f870f7 tempest-VolumeImageDependencyTests-151009898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-986bd2ea-b707-43fa-bdfa-592545e528d7" returned: 0 in 0.701s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b52753b1-4ab1-4a36-bee8-5da195f870f7 tempest-VolumeImageDependencyTests-151009898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-986bd2ea-b707-43fa-bdfa-592545e528d7 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e90beaf9-0cce-42c5-9bdb-2b5dd1cd4085 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:09:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e90beaf9-0cce-42c5-9bdb-2b5dd1cd4085 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.025s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:09:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e90beaf9-0cce-42c5-9bdb-2b5dd1cd4085 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:09:03 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e90beaf9-0cce-42c5-9bdb-2b5dd1cd4085 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:09:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e90beaf9-0cce-42c5-9bdb-2b5dd1cd4085 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:09:03 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e90beaf9-0cce-42c5-9bdb-2b5dd1cd4085 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e90beaf9-0cce-42c5-9bdb-2b5dd1cd4085 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.228s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:04 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-e90beaf9-0cce-42c5-9bdb-2b5dd1cd4085 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:09:04 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-e90beaf9-0cce-42c5-9bdb-2b5dd1cd4085 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Deleted volume successfully.
Sep 10 12:09:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b52753b1-4ab1-4a36-bee8-5da195f870f7 tempest-VolumeImageDependencyTests-151009898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-986bd2ea-b707-43fa-bdfa-592545e528d7" returned: 1 in 1.124s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b52753b1-4ab1-4a36-bee8-5da195f870f7 tempest-VolumeImageDependencyTests-151009898 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-986bd2ea-b707-43fa-bdfa-592545e528d7' failed. Not Retrying. {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 12:09:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b52753b1-4ab1-4a36-bee8-5da195f870f7 tempest-VolumeImageDependencyTests-151009898 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-986bd2ea-b707-43fa-bdfa-592545e528d7 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:04 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-c9e77107-6135-4f37-a1cb-9cefe6232a0e tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "cinder-04583e58-71db-46a4-ac4d-df125d99f279-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:09:04 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b52753b1-4ab1-4a36-bee8-5da195f870f7 tempest-VolumeImageDependencyTests-151009898 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-986bd2ea-b707-43fa-bdfa-592545e528d7" returned: 0 in 0.368s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:05 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e90beaf9-0cce-42c5-9bdb-2b5dd1cd4085 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "cinder-f9f84e6c-b152-499d-a9d1-22ff0a8ea502-delete_volume" released by "delete_volume" :: held 3.850s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:09:05 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-c9e77107-6135-4f37-a1cb-9cefe6232a0e tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "cinder-04583e58-71db-46a4-ac4d-df125d99f279-delete_volume" acquired by "delete_volume" :: waited 0.191s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:09:05 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b52753b1-4ab1-4a36-bee8-5da195f870f7 tempest-VolumeImageDependencyTests-151009898 None] Lock "cinder-quobyte-986bd2ea-b707-43fa-bdfa-592545e528d7" released by "delete_volume" :: held 2.511s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:09:05 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-c9e77107-6135-4f37-a1cb-9cefe6232a0e tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:09:05 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-c9e77107-6135-4f37-a1cb-9cefe6232a0e tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "cinder-quobyte-04583e58-71db-46a4-ac4d-df125d99f279" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:09:05 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-c9e77107-6135-4f37-a1cb-9cefe6232a0e tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "cinder-quobyte-04583e58-71db-46a4-ac4d-df125d99f279" acquired by "delete_volume" :: waited 0.016s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:09:05 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfff50d-59bf-4768-9dce-c27da2c6be4d]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:09:05 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c9e77107-6135-4f37-a1cb-9cefe6232a0e tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-04583e58-71db-46a4-ac4d-df125d99f279 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:05 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-b52753b1-4ab1-4a36-bee8-5da195f870f7 tempest-VolumeImageDependencyTests-151009898 None] Created reservations ['cdc46409-5a01-4503-9690-824a95520957', '7045c485-c04d-4226-a341-88aa140f0cfe', '31165232-6b28-4c55-a394-ca9603bb0a28', '2a1b3a83-db16-433f-89e2-29fb19e18fcd'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:09:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b52753b1-4ab1-4a36-bee8-5da195f870f7 tempest-VolumeImageDependencyTests-151009898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:09:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b52753b1-4ab1-4a36-bee8-5da195f870f7 tempest-VolumeImageDependencyTests-151009898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:09:06 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b52753b1-4ab1-4a36-bee8-5da195f870f7 tempest-VolumeImageDependencyTests-151009898 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:09:06 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-b52753b1-4ab1-4a36-bee8-5da195f870f7 tempest-VolumeImageDependencyTests-151009898 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:09:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-b52753b1-4ab1-4a36-bee8-5da195f870f7 tempest-VolumeImageDependencyTests-151009898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:09:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b52753b1-4ab1-4a36-bee8-5da195f870f7 tempest-VolumeImageDependencyTests-151009898 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-b52753b1-4ab1-4a36-bee8-5da195f870f7 tempest-VolumeImageDependencyTests-151009898 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.198s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:06 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-b52753b1-4ab1-4a36-bee8-5da195f870f7 tempest-VolumeImageDependencyTests-151009898 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:09:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c9e77107-6135-4f37-a1cb-9cefe6232a0e tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-04583e58-71db-46a4-ac4d-df125d99f279" returned: 0 in 1.116s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c9e77107-6135-4f37-a1cb-9cefe6232a0e tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-04583e58-71db-46a4-ac4d-df125d99f279 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:06 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-b52753b1-4ab1-4a36-bee8-5da195f870f7 tempest-VolumeImageDependencyTests-151009898 None] Deleted volume successfully.
Sep 10 12:09:06 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c9e77107-6135-4f37-a1cb-9cefe6232a0e tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-04583e58-71db-46a4-ac4d-df125d99f279" returned: 0 in 0.360s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:06 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-c9e77107-6135-4f37-a1cb-9cefe6232a0e tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "cinder-quobyte-04583e58-71db-46a4-ac4d-df125d99f279" released by "delete_volume" :: held 1.603s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:09:06 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-b52753b1-4ab1-4a36-bee8-5da195f870f7 tempest-VolumeImageDependencyTests-151009898 None] Lock "cinder-986bd2ea-b707-43fa-bdfa-592545e528d7-delete_volume" released by "delete_volume" :: held 5.196s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:09:07 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-c9e77107-6135-4f37-a1cb-9cefe6232a0e tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Created reservations ['c64eacc1-6537-406e-b5ac-0b86ada6a771', '035ef016-5cb7-4ddb-9d49-c28c0c80e76a', 'a6573dd7-5c66-40c3-b1b3-781a6299843a', '5eda1c45-f24c-4bfc-b044-5ca927951c72'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:09:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-c9e77107-6135-4f37-a1cb-9cefe6232a0e tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:09:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-c9e77107-6135-4f37-a1cb-9cefe6232a0e tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:09:07 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-c9e77107-6135-4f37-a1cb-9cefe6232a0e tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:09:07 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-c9e77107-6135-4f37-a1cb-9cefe6232a0e tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:09:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-c9e77107-6135-4f37-a1cb-9cefe6232a0e tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:09:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c9e77107-6135-4f37-a1cb-9cefe6232a0e tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:07 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-c9e77107-6135-4f37-a1cb-9cefe6232a0e tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.130s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:07 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-c9e77107-6135-4f37-a1cb-9cefe6232a0e tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:09:07 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-c9e77107-6135-4f37-a1cb-9cefe6232a0e tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Deleted volume successfully.
Sep 10 12:09:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-c9e77107-6135-4f37-a1cb-9cefe6232a0e tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "cinder-04583e58-71db-46a4-ac4d-df125d99f279-delete_volume" released by "delete_volume" :: held 3.181s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:09:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-30402810-98d2-455a-909d-f18d7e2b6b4f tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "cinder-e4519ade-3534-4db0-908f-eb253ac82ca5-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:09:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-30402810-98d2-455a-909d-f18d7e2b6b4f tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "cinder-e4519ade-3534-4db0-908f-eb253ac82ca5-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:09:08 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-30402810-98d2-455a-909d-f18d7e2b6b4f tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:09:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-30402810-98d2-455a-909d-f18d7e2b6b4f tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "cinder-quobyte-e4519ade-3534-4db0-908f-eb253ac82ca5" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:09:08 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-30402810-98d2-455a-909d-f18d7e2b6b4f tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "cinder-quobyte-e4519ade-3534-4db0-908f-eb253ac82ca5" acquired by "delete_volume" :: waited 0.015s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:09:08 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d626e544-266a-4838-9a33-20a194565e9e]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:09:08 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-30402810-98d2-455a-909d-f18d7e2b6b4f tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e4519ade-3534-4db0-908f-eb253ac82ca5 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-30402810-98d2-455a-909d-f18d7e2b6b4f tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e4519ade-3534-4db0-908f-eb253ac82ca5" returned: 0 in 0.546s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-30402810-98d2-455a-909d-f18d7e2b6b4f tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e4519ade-3534-4db0-908f-eb253ac82ca5 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:09 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-30402810-98d2-455a-909d-f18d7e2b6b4f tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-e4519ade-3534-4db0-908f-eb253ac82ca5" returned: 0 in 0.218s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:09 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-30402810-98d2-455a-909d-f18d7e2b6b4f tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "cinder-quobyte-e4519ade-3534-4db0-908f-eb253ac82ca5" released by "delete_volume" :: held 1.063s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:09:10 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-30402810-98d2-455a-909d-f18d7e2b6b4f tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Created reservations ['f649c95f-cdf3-47b3-a569-d3be2cdece44', '78abf762-17fb-4b09-aef9-d8550a22edce', 'cee80f7a-81e9-48e3-841e-d53f60efb1f8', '3ee7cce5-1b39-4af2-8e8d-e9c1d5c3f477'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:09:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-30402810-98d2-455a-909d-f18d7e2b6b4f tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:09:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-30402810-98d2-455a-909d-f18d7e2b6b4f tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:09:10 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-30402810-98d2-455a-909d-f18d7e2b6b4f tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:09:10 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-30402810-98d2-455a-909d-f18d7e2b6b4f tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:09:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-30402810-98d2-455a-909d-f18d7e2b6b4f tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:09:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-30402810-98d2-455a-909d-f18d7e2b6b4f tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:10 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-30402810-98d2-455a-909d-f18d7e2b6b4f tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.208s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:10 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-30402810-98d2-455a-909d-f18d7e2b6b4f tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:09:10 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-30402810-98d2-455a-909d-f18d7e2b6b4f tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Deleted volume successfully.
Sep 10 12:09:11 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-36fe67a2-b115-4e30-a73d-eca58726b4e9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "cinder-9543f593-9a54-4979-8c85-8ed93b1bc5b5-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:09:11 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-30402810-98d2-455a-909d-f18d7e2b6b4f tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "cinder-e4519ade-3534-4db0-908f-eb253ac82ca5-delete_volume" released by "delete_volume" :: held 2.786s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:09:11 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-36fe67a2-b115-4e30-a73d-eca58726b4e9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "cinder-9543f593-9a54-4979-8c85-8ed93b1bc5b5-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:09:11 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-36fe67a2-b115-4e30-a73d-eca58726b4e9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:09:11 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-36fe67a2-b115-4e30-a73d-eca58726b4e9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "cinder-quobyte-9543f593-9a54-4979-8c85-8ed93b1bc5b5" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:09:11 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-36fe67a2-b115-4e30-a73d-eca58726b4e9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "cinder-quobyte-9543f593-9a54-4979-8c85-8ed93b1bc5b5" acquired by "delete_volume" :: waited 0.031s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:09:11 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d00448-c984-4707-a79d-8b5d08988a01]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:09:11 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-36fe67a2-b115-4e30-a73d-eca58726b4e9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9543f593-9a54-4979-8c85-8ed93b1bc5b5 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-36fe67a2-b115-4e30-a73d-eca58726b4e9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9543f593-9a54-4979-8c85-8ed93b1bc5b5" returned: 0 in 0.784s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-36fe67a2-b115-4e30-a73d-eca58726b4e9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9543f593-9a54-4979-8c85-8ed93b1bc5b5 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:12 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-36fe67a2-b115-4e30-a73d-eca58726b4e9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-9543f593-9a54-4979-8c85-8ed93b1bc5b5" returned: 0 in 0.189s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:12 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-36fe67a2-b115-4e30-a73d-eca58726b4e9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "cinder-quobyte-9543f593-9a54-4979-8c85-8ed93b1bc5b5" released by "delete_volume" :: held 1.316s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:09:13 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-36fe67a2-b115-4e30-a73d-eca58726b4e9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Created reservations ['022e3761-e348-4670-b540-ceb1fd712bb9', '4b88fab5-2fbe-42a9-b8d0-297baed47bf8', '7b82922a-e527-4cdc-b6e1-6c16c53e7488', '5424cd22-caa8-4107-8ebd-e05865434419'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:09:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-36fe67a2-b115-4e30-a73d-eca58726b4e9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:09:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-36fe67a2-b115-4e30-a73d-eca58726b4e9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:09:13 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-36fe67a2-b115-4e30-a73d-eca58726b4e9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:09:13 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-36fe67a2-b115-4e30-a73d-eca58726b4e9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:09:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-36fe67a2-b115-4e30-a73d-eca58726b4e9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:09:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-36fe67a2-b115-4e30-a73d-eca58726b4e9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:13 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7838e86c-a848-4765-bd27-88eccd434993 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "cinder-3a4478cc-2b0d-4272-94f9-bd79f149379d-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:09:13 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-36fe67a2-b115-4e30-a73d-eca58726b4e9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.515s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:14 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-36fe67a2-b115-4e30-a73d-eca58726b4e9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:09:14 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-36fe67a2-b115-4e30-a73d-eca58726b4e9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Deleted volume successfully.
Sep 10 12:09:14 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7838e86c-a848-4765-bd27-88eccd434993 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "cinder-3a4478cc-2b0d-4272-94f9-bd79f149379d-delete_volume" acquired by "delete_volume" :: waited 0.250s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:09:14 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-36fe67a2-b115-4e30-a73d-eca58726b4e9 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "cinder-9543f593-9a54-4979-8c85-8ed93b1bc5b5-delete_volume" released by "delete_volume" :: held 2.862s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:09:14 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-7838e86c-a848-4765-bd27-88eccd434993 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:09:14 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7838e86c-a848-4765-bd27-88eccd434993 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "cinder-quobyte-3a4478cc-2b0d-4272-94f9-bd79f149379d" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:09:14 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7838e86c-a848-4765-bd27-88eccd434993 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "cinder-quobyte-3a4478cc-2b0d-4272-94f9-bd79f149379d" acquired by "delete_volume" :: waited 0.012s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:09:14 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[328edb60-423f-4d03-9d88-2655781fa56d]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:09:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7838e86c-a848-4765-bd27-88eccd434993 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3a4478cc-2b0d-4272-94f9-bd79f149379d {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7838e86c-a848-4765-bd27-88eccd434993 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3a4478cc-2b0d-4272-94f9-bd79f149379d" returned: 0 in 0.457s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:14 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7838e86c-a848-4765-bd27-88eccd434993 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3a4478cc-2b0d-4272-94f9-bd79f149379d {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7838e86c-a848-4765-bd27-88eccd434993 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-3a4478cc-2b0d-4272-94f9-bd79f149379d" returned: 0 in 0.101s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:15 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7838e86c-a848-4765-bd27-88eccd434993 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "cinder-quobyte-3a4478cc-2b0d-4272-94f9-bd79f149379d" released by "delete_volume" :: held 0.798s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:09:15 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-7838e86c-a848-4765-bd27-88eccd434993 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Created reservations ['86d29fc1-2721-4f28-b6a1-651359636920', 'b4418646-cf31-4304-acb1-76afe4f7635f', '9abd3668-bf6b-4c00-bae7-9da32c05e2e4', '25f3c986-7f7e-49a5-a8d4-1157509cad37'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:09:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7838e86c-a848-4765-bd27-88eccd434993 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:09:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7838e86c-a848-4765-bd27-88eccd434993 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:09:15 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-7838e86c-a848-4765-bd27-88eccd434993 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:09:15 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-7838e86c-a848-4765-bd27-88eccd434993 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:09:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-7838e86c-a848-4765-bd27-88eccd434993 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:09:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7838e86c-a848-4765-bd27-88eccd434993 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:15 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-7838e86c-a848-4765-bd27-88eccd434993 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.169s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:15 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-7838e86c-a848-4765-bd27-88eccd434993 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:09:16 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-7838e86c-a848-4765-bd27-88eccd434993 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Deleted volume successfully.
Sep 10 12:09:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ee75e068-2415-4bcd-9db7-f0bec05e8186 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "cinder-6fae2e8a-d717-46b2-a4b4-662938c521b1-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:09:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ee75e068-2415-4bcd-9db7-f0bec05e8186 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "cinder-6fae2e8a-d717-46b2-a4b4-662938c521b1-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:09:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-7838e86c-a848-4765-bd27-88eccd434993 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "cinder-3a4478cc-2b0d-4272-94f9-bd79f149379d-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:09:16 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-ee75e068-2415-4bcd-9db7-f0bec05e8186 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:09:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ee75e068-2415-4bcd-9db7-f0bec05e8186 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "cinder-quobyte-6fae2e8a-d717-46b2-a4b4-662938c521b1" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:09:16 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ee75e068-2415-4bcd-9db7-f0bec05e8186 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "cinder-quobyte-6fae2e8a-d717-46b2-a4b4-662938c521b1" acquired by "delete_volume" :: waited 0.019s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:09:16 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[01be52a9-cadc-4cd5-a529-d35afb2d36fd]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:09:16 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ee75e068-2415-4bcd-9db7-f0bec05e8186 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6fae2e8a-d717-46b2-a4b4-662938c521b1 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ee75e068-2415-4bcd-9db7-f0bec05e8186 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6fae2e8a-d717-46b2-a4b4-662938c521b1" returned: 0 in 0.587s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ee75e068-2415-4bcd-9db7-f0bec05e8186 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6fae2e8a-d717-46b2-a4b4-662938c521b1 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:17 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ee75e068-2415-4bcd-9db7-f0bec05e8186 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-6fae2e8a-d717-46b2-a4b4-662938c521b1" returned: 0 in 0.118s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:17 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ee75e068-2415-4bcd-9db7-f0bec05e8186 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "cinder-quobyte-6fae2e8a-d717-46b2-a4b4-662938c521b1" released by "delete_volume" :: held 0.972s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:09:17 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-ee75e068-2415-4bcd-9db7-f0bec05e8186 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Created reservations ['4155c856-bed1-448b-8d8d-443eb4e80e79', 'e0a4a6a2-50b9-4d3f-babd-9743a085883d', '582623ed-4c07-4614-876b-4091916838d6', 'a79d0297-b5fb-4c1b-a2f2-e52f1ec14893'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:09:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ee75e068-2415-4bcd-9db7-f0bec05e8186 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:09:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ee75e068-2415-4bcd-9db7-f0bec05e8186 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:09:18 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ee75e068-2415-4bcd-9db7-f0bec05e8186 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:09:18 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-ee75e068-2415-4bcd-9db7-f0bec05e8186 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:09:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-ee75e068-2415-4bcd-9db7-f0bec05e8186 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:09:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ee75e068-2415-4bcd-9db7-f0bec05e8186 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:18 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-ee75e068-2415-4bcd-9db7-f0bec05e8186 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.120s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:18 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-ee75e068-2415-4bcd-9db7-f0bec05e8186 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:09:18 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-ee75e068-2415-4bcd-9db7-f0bec05e8186 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Deleted volume successfully.
Sep 10 12:09:18 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-ee75e068-2415-4bcd-9db7-f0bec05e8186 tempest-CreateVolumesFromSourceVolumeTest-1315998106 None] Lock "cinder-6fae2e8a-d717-46b2-a4b4-662938c521b1-delete_volume" released by "delete_volume" :: held 2.244s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG oslo_service.periodic_task [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82594) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.113s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-bcb5d7e1-894c-452a-acd7-533ba0320c90 None None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:09:23 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Flow 'volume_create_manager' (0d7bf4d4-254c-490e-bde8-e8f5249eae23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804dc788-7129-4592-86ca-eb7f5da397ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804dc788-7129-4592-86ca-eb7f5da397ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c9279d8-39ba-4f69-ae43-abfa3aa08308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a43f195173f54ff9a0397c8897c093ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:09:23Z,use_quota=True,user_id='927558c302174bd186c4cbb75ecbc126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3386f4d8-2bcb-4491-8396-9ca63294de72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3386f4d8-2bcb-4491-8396-9ca63294de72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c89c22e-8a2a-4e55-bbbe-cfd74e5d072e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c89c22e-8a2a-4e55-bbbe-cfd74e5d072e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c9279d8-39ba-4f69-ae43-abfa3aa08308', 'volume_name': 'volume-8c9279d8-39ba-4f69-ae43-abfa3aa08308', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138280ba-3020-4724-a27e-73316e249645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138280ba-3020-4724-a27e-73316e249645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d38f627b-324e-4881-a65b-9a58099dbb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:09:23 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Volume 8c9279d8-39ba-4f69-ae43-abfa3aa08308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c9279d8-39ba-4f69-ae43-abfa3aa08308', 'volume_size': 1}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c9279d8-39ba-4f69-ae43-abfa3aa08308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a43f195173f54ff9a0397c8897c093ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:09:23Z,use_quota=True,user_id='927558c302174bd186c4cbb75ecbc126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Creating volume 8c9279d8-39ba-4f69-ae43-abfa3aa08308 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:09:23 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:09:23 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8c9279d8-39ba-4f69-ae43-abfa3aa08308 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:24 devstack quobyte-client[82616]: System call of process 99946 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:09:24 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=170, name=volume-8c9279d8-39ba-4f69-ae43-abfa3aa08308, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:09:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8c9279d8-39ba-4f69-ae43-abfa3aa08308 1073741824" returned: 0 in 0.383s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8c9279d8-39ba-4f69-ae43-abfa3aa08308 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8c9279d8-39ba-4f69-ae43-abfa3aa08308" returned: 0 in 0.131s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:24 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] <== create_volume: return (572ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:09:24 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.582s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:09:24 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d38f627b-324e-4881-a65b-9a58099dbb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c9279d8-39ba-4f69-ae43-abfa3aa08308', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:09:24 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19206983-f43f-445e-b4ec-51031780de06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:09:24 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Volume volume-8c9279d8-39ba-4f69-ae43-abfa3aa08308 (8c9279d8-39ba-4f69-ae43-abfa3aa08308): created successfully
Sep 10 12:09:24 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19206983-f43f-445e-b4ec-51031780de06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:09:24 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Flow 'volume_create_manager' (0d7bf4d4-254c-490e-bde8-e8f5249eae23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:09:24 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-56621692-7894-49b4-a5a6-7b4de6975d3f tempest-CinderUnicodeTest-1925328654 None] Created volume successfully.
Sep 10 12:09:26 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG cinder.volume.flows.manager.create_volume [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Flow 'volume_create_manager' (98fa6963-23ed-4827-be44-2e107dd443bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2cb4084-eaa5-401e-a9da-0a2ff190f991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2cb4084-eaa5-401e-a9da-0a2ff190f991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:09:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-363713890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3799f5-9526-4f61-ac63-3ff105170a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a43f195173f54ff9a0397c8897c093ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:09:26Z,use_quota=True,user_id='927558c302174bd186c4cbb75ecbc126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb79843-d3c5-40b9-960f-8827e10f950e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb79843-d3c5-40b9-960f-8827e10f950e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c521d250-5823-4638-88de-66aa6d9e6555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c521d250-5823-4638-88de-66aa6d9e6555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae3799f5-9526-4f61-ac63-3ff105170a12', 'volume_name': 'volume-ae3799f5-9526-4f61-ac63-3ff105170a12', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f082c1-f918-4bcc-80a4-c8ff5547bca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f082c1-f918-4bcc-80a4-c8ff5547bca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f52377bd-ba66-4c0c-b0ca-bb3152d0e601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:09:26 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Volume ae3799f5-9526-4f61-ac63-3ff105170a12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae3799f5-9526-4f61-ac63-3ff105170a12', 'volume_size': 1}
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4f52e799f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T10:09:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-363713890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3799f5-9526-4f61-ac63-3ff105170a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a43f195173f54ff9a0397c8897c093ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T10:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T10:09:26Z,use_quota=True,user_id='927558c302174bd186c4cbb75ecbc126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6465a5d-bcbf-457a-a2ad-b1bade7be1e9),volume_type_id=a6465a5d-bcbf-457a-a2ad-b1bade7be1e9)}" {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Creating volume ae3799f5-9526-4f61-ac63-3ff105170a12 {{(pid=82594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Selected 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56 as target Quobyte volume. {{(pid=82594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 12:09:26 devstack cinder-volume[82594]: INFO cinder.volume.drivers.remotefs [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] casted to 10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12 1073741824 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:26 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=171, name=volume-ae3799f5-9526-4f61-ac63-3ff105170a12, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12 1073741824" returned: 0 in 0.347s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12" returned: 0 in 0.091s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] <== create_volume: return (504ms) {'provider_location': '10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'} {{(pid=82594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 12:09:26 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.516s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:09:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f52377bd-ba66-4c0c-b0ca-bb3152d0e601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae3799f5-9526-4f61-ac63-3ff105170a12', 'volume_size': 1}' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:09:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b31ef21-7e0d-452f-a0b8-c220f0f1f986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 12:09:27 devstack cinder-volume[82594]: INFO cinder.volume.flows.manager.create_volume [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Volume volume-ae3799f5-9526-4f61-ac63-3ff105170a12 (ae3799f5-9526-4f61-ac63-3ff105170a12): created successfully
Sep 10 12:09:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b31ef21-7e0d-452f-a0b8-c220f0f1f986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82594) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 12:09:27 devstack cinder-volume[82594]: DEBUG cinder.volume.manager [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Flow 'volume_create_manager' (98fa6963-23ed-4827-be44-2e107dd443bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82594) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 12:09:27 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-80b5a67a-647a-47f9-b42e-846930511249 tempest-CinderUnicodeTest-1925328654 None] Created volume successfully.
Sep 10 12:09:28 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-0c3368f6-e89f-4a1e-b494-0dd64005ad51 tempest-CinderUnicodeTest-1925328654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:09:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0c3368f6-e89f-4a1e-b494-0dd64005ad51 tempest-CinderUnicodeTest-1925328654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:09:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0c3368f6-e89f-4a1e-b494-0dd64005ad51 tempest-CinderUnicodeTest-1925328654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:09:28 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-0c3368f6-e89f-4a1e-b494-0dd64005ad51 tempest-CinderUnicodeTest-1925328654 None] Creating offline snapshot 70b6d7e2-1912-473c-a5c2-1fa831fb734f of volume ae3799f5-9526-4f61-ac63-3ff105170a12 {{(pid=82594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 12:09:28 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a3bc23-e5e2-4607-826c-642a3e248360]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:09:28 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0c3368f6-e89f-4a1e-b494-0dd64005ad51 tempest-CinderUnicodeTest-1925328654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0c3368f6-e89f-4a1e-b494-0dd64005ad51 tempest-CinderUnicodeTest-1925328654 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12" returned: 0 in 0.403s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0c3368f6-e89f-4a1e-b494-0dd64005ad51 tempest-CinderUnicodeTest-1925328654 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12.70b6d7e2-1912-473c-a5c2-1fa831fb734f 1G {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:29 devstack quobyte-client[82616]: The server volume:e8f724f4-479a-4f9b-ac4a-033479940815@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e8f724f4-479a-4f9b-ac4a-033479940815, inode=172, name=volume-ae3799f5-9526-4f61-ac63-3ff105170a12.70b6d7e2-1912-473c-a5c2-1fa831fb734f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.211), requestorAccessMask=0
Sep 10 12:09:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0c3368f6-e89f-4a1e-b494-0dd64005ad51 tempest-CinderUnicodeTest-1925328654 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12.70b6d7e2-1912-473c-a5c2-1fa831fb734f 1G" returned: 0 in 0.223s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0c3368f6-e89f-4a1e-b494-0dd64005ad51 tempest-CinderUnicodeTest-1925328654 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ae3799f5-9526-4f61-ac63-3ff105170a12 -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12.70b6d7e2-1912-473c-a5c2-1fa831fb734f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:29 devstack quobyte-client[82616]: System call of process 99960 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:09:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0c3368f6-e89f-4a1e-b494-0dd64005ad51 tempest-CinderUnicodeTest-1925328654 None] CMD "qemu-img rebase -u -b volume-ae3799f5-9526-4f61-ac63-3ff105170a12 -F qcow2 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12.70b6d7e2-1912-473c-a5c2-1fa831fb734f" returned: 0 in 0.162s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-0c3368f6-e89f-4a1e-b494-0dd64005ad51 tempest-CinderUnicodeTest-1925328654 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12.70b6d7e2-1912-473c-a5c2-1fa831fb734f is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 12:09:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0c3368f6-e89f-4a1e-b494-0dd64005ad51 tempest-CinderUnicodeTest-1925328654 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12.70b6d7e2-1912-473c-a5c2-1fa831fb734f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0c3368f6-e89f-4a1e-b494-0dd64005ad51 tempest-CinderUnicodeTest-1925328654 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12.70b6d7e2-1912-473c-a5c2-1fa831fb734f" returned: 0 in 0.086s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:29 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-0c3368f6-e89f-4a1e-b494-0dd64005ad51 tempest-CinderUnicodeTest-1925328654 None] Setting permissions: /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12 -> 1000:1000 {{(pid=82594) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 12:09:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0c3368f6-e89f-4a1e-b494-0dd64005ad51 tempest-CinderUnicodeTest-1925328654 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12.70b6d7e2-1912-473c-a5c2-1fa831fb734f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0c3368f6-e89f-4a1e-b494-0dd64005ad51 tempest-CinderUnicodeTest-1925328654 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12.70b6d7e2-1912-473c-a5c2-1fa831fb734f" returned: 0 in 0.086s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:29 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0c3368f6-e89f-4a1e-b494-0dd64005ad51 tempest-CinderUnicodeTest-1925328654 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0c3368f6-e89f-4a1e-b494-0dd64005ad51 tempest-CinderUnicodeTest-1925328654 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12.info" returned: 0 in 0.093s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:30 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-0c3368f6-e89f-4a1e-b494-0dd64005ad51 tempest-CinderUnicodeTest-1925328654 None] File path /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12.info is being set with permissions: 660 {{(pid=82594) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 12:09:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0c3368f6-e89f-4a1e-b494-0dd64005ad51 tempest-CinderUnicodeTest-1925328654 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12.info {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-0c3368f6-e89f-4a1e-b494-0dd64005ad51 tempest-CinderUnicodeTest-1925328654 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12.info" returned: 0 in 0.096s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-0c3368f6-e89f-4a1e-b494-0dd64005ad51 tempest-CinderUnicodeTest-1925328654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.501s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:09:30 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-0c3368f6-e89f-4a1e-b494-0dd64005ad51 tempest-CinderUnicodeTest-1925328654 None] Create snapshot completed successfully
Sep 10 12:09:30 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a3417b79-d761-4431-897e-71f981b5cbd7 tempest-CinderUnicodeTest-1925328654 None] Acquiring lock "cinder-70b6d7e2-1912-473c-a5c2-1fa831fb734f-delete_snapshot" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:09:30 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a3417b79-d761-4431-897e-71f981b5cbd7 tempest-CinderUnicodeTest-1925328654 None] Lock "cinder-70b6d7e2-1912-473c-a5c2-1fa831fb734f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:09:30 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-a3417b79-d761-4431-897e-71f981b5cbd7 tempest-CinderUnicodeTest-1925328654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:09:30 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a3417b79-d761-4431-897e-71f981b5cbd7 tempest-CinderUnicodeTest-1925328654 None] Acquiring lock "cinder-quobyte-ae3799f5-9526-4f61-ac63-3ff105170a12" by "delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:09:30 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a3417b79-d761-4431-897e-71f981b5cbd7 tempest-CinderUnicodeTest-1925328654 None] Lock "cinder-quobyte-ae3799f5-9526-4f61-ac63-3ff105170a12" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:09:30 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a3417b79-d761-4431-897e-71f981b5cbd7 tempest-CinderUnicodeTest-1925328654 None] Acquiring lock "cinder-quobyte-70b6d7e2-1912-473c-a5c2-1fa831fb734f" by "_delete_snapshot" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:09:30 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a3417b79-d761-4431-897e-71f981b5cbd7 tempest-CinderUnicodeTest-1925328654 None] Lock "cinder-quobyte-70b6d7e2-1912-473c-a5c2-1fa831fb734f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:09:30 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-a3417b79-d761-4431-897e-71f981b5cbd7 tempest-CinderUnicodeTest-1925328654 None] Deleting offline snapshot 70b6d7e2-1912-473c-a5c2-1fa831fb734f of volume ae3799f5-9526-4f61-ac63-3ff105170a12 {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 12:09:30 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-a3417b79-d761-4431-897e-71f981b5cbd7 tempest-CinderUnicodeTest-1925328654 None] snapshot_file for this snap is: volume-ae3799f5-9526-4f61-ac63-3ff105170a12.70b6d7e2-1912-473c-a5c2-1fa831fb734f {{(pid=82594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 12:09:30 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[567ebcab-01f1-47ed-9bbd-4272570cd249]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:09:30 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a3417b79-d761-4431-897e-71f981b5cbd7 tempest-CinderUnicodeTest-1925328654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12.70b6d7e2-1912-473c-a5c2-1fa831fb734f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a3417b79-d761-4431-897e-71f981b5cbd7 tempest-CinderUnicodeTest-1925328654 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12.70b6d7e2-1912-473c-a5c2-1fa831fb734f" returned: 0 in 0.405s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:31 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.remotefs [None req-a3417b79-d761-4431-897e-71f981b5cbd7 tempest-CinderUnicodeTest-1925328654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae3799f5-9526-4f61-ac63-3ff105170a12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 12:09:31 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[862b70e4-956c-4d15-9b95-501dbf378f3e]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:09:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a3417b79-d761-4431-897e-71f981b5cbd7 tempest-CinderUnicodeTest-1925328654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a3417b79-d761-4431-897e-71f981b5cbd7 tempest-CinderUnicodeTest-1925328654 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12" returned: 0 in 0.420s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:31 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a3417b79-d761-4431-897e-71f981b5cbd7 tempest-CinderUnicodeTest-1925328654 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12.70b6d7e2-1912-473c-a5c2-1fa831fb734f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:32 devstack quobyte-client[82616]: System call of process 99974 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 12:09:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a3417b79-d761-4431-897e-71f981b5cbd7 tempest-CinderUnicodeTest-1925328654 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12.70b6d7e2-1912-473c-a5c2-1fa831fb734f" returned: 0 in 0.213s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a3417b79-d761-4431-897e-71f981b5cbd7 tempest-CinderUnicodeTest-1925328654 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12.70b6d7e2-1912-473c-a5c2-1fa831fb734f {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:32 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-a3417b79-d761-4431-897e-71f981b5cbd7 tempest-CinderUnicodeTest-1925328654 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12.70b6d7e2-1912-473c-a5c2-1fa831fb734f" returned: 0 in 0.084s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:32 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a3417b79-d761-4431-897e-71f981b5cbd7 tempest-CinderUnicodeTest-1925328654 None] Lock "cinder-quobyte-70b6d7e2-1912-473c-a5c2-1fa831fb734f" released by "_delete_snapshot" :: held 1.416s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:09:32 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a3417b79-d761-4431-897e-71f981b5cbd7 tempest-CinderUnicodeTest-1925328654 None] Lock "cinder-quobyte-ae3799f5-9526-4f61-ac63-3ff105170a12" released by "delete_snapshot" :: held 1.442s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:09:32 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-a3417b79-d761-4431-897e-71f981b5cbd7 tempest-CinderUnicodeTest-1925328654 None] Created reservations ['e3ab4c6e-09bd-46e3-a59c-726fb20581da', '85c2583c-a4a8-42ea-a349-29eda8a2b7d9', '6f49e876-9282-423c-aca6-b8abdf681e6c', '54dee8b5-dc44-4e3e-a40b-f5306a91c8f8'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:09:32 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-a3417b79-d761-4431-897e-71f981b5cbd7 tempest-CinderUnicodeTest-1925328654 None] Delete snapshot completed successfully.
Sep 10 12:09:32 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-a3417b79-d761-4431-897e-71f981b5cbd7 tempest-CinderUnicodeTest-1925328654 None] Lock "cinder-70b6d7e2-1912-473c-a5c2-1fa831fb734f-delete_snapshot" released by "delete_snapshot" :: held 1.888s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:09:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e848f6d8-8ff9-445b-b958-eb5ba2559d98 tempest-CinderUnicodeTest-1925328654 None] Acquiring lock "cinder-ae3799f5-9526-4f61-ac63-3ff105170a12-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:09:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e848f6d8-8ff9-445b-b958-eb5ba2559d98 tempest-CinderUnicodeTest-1925328654 None] Lock "cinder-ae3799f5-9526-4f61-ac63-3ff105170a12-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:09:33 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-e848f6d8-8ff9-445b-b958-eb5ba2559d98 tempest-CinderUnicodeTest-1925328654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:09:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e848f6d8-8ff9-445b-b958-eb5ba2559d98 tempest-CinderUnicodeTest-1925328654 None] Acquiring lock "cinder-quobyte-ae3799f5-9526-4f61-ac63-3ff105170a12" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:09:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e848f6d8-8ff9-445b-b958-eb5ba2559d98 tempest-CinderUnicodeTest-1925328654 None] Lock "cinder-quobyte-ae3799f5-9526-4f61-ac63-3ff105170a12" acquired by "delete_volume" :: waited 0.018s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:09:33 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd94a764-6ba4-4309-a36b-53cbe0a14acf]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:09:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e848f6d8-8ff9-445b-b958-eb5ba2559d98 tempest-CinderUnicodeTest-1925328654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e848f6d8-8ff9-445b-b958-eb5ba2559d98 tempest-CinderUnicodeTest-1925328654 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12" returned: 0 in 0.410s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e848f6d8-8ff9-445b-b958-eb5ba2559d98 tempest-CinderUnicodeTest-1925328654 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:33 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e848f6d8-8ff9-445b-b958-eb5ba2559d98 tempest-CinderUnicodeTest-1925328654 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-ae3799f5-9526-4f61-ac63-3ff105170a12" returned: 0 in 0.090s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:33 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e848f6d8-8ff9-445b-b958-eb5ba2559d98 tempest-CinderUnicodeTest-1925328654 None] Lock "cinder-quobyte-ae3799f5-9526-4f61-ac63-3ff105170a12" released by "delete_volume" :: held 0.693s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:09:34 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-e848f6d8-8ff9-445b-b958-eb5ba2559d98 tempest-CinderUnicodeTest-1925328654 None] Created reservations ['d055b6da-17d3-4c63-b90b-e832c52dbd7b', '6aa319c4-023b-4a78-9c98-ae17d84824c4', '1a607d73-9031-449e-b9aa-02651e787520', '1c20452c-8c0e-4228-a516-d1aac32b2897'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:09:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e848f6d8-8ff9-445b-b958-eb5ba2559d98 tempest-CinderUnicodeTest-1925328654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:09:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e848f6d8-8ff9-445b-b958-eb5ba2559d98 tempest-CinderUnicodeTest-1925328654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:09:34 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e848f6d8-8ff9-445b-b958-eb5ba2559d98 tempest-CinderUnicodeTest-1925328654 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:09:34 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-e848f6d8-8ff9-445b-b958-eb5ba2559d98 tempest-CinderUnicodeTest-1925328654 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:09:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-e848f6d8-8ff9-445b-b958-eb5ba2559d98 tempest-CinderUnicodeTest-1925328654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:09:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e848f6d8-8ff9-445b-b958-eb5ba2559d98 tempest-CinderUnicodeTest-1925328654 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:34 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-e848f6d8-8ff9-445b-b958-eb5ba2559d98 tempest-CinderUnicodeTest-1925328654 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.112s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:34 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-e848f6d8-8ff9-445b-b958-eb5ba2559d98 tempest-CinderUnicodeTest-1925328654 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:09:34 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-e848f6d8-8ff9-445b-b958-eb5ba2559d98 tempest-CinderUnicodeTest-1925328654 None] Deleted volume successfully.
Sep 10 12:09:34 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-e848f6d8-8ff9-445b-b958-eb5ba2559d98 tempest-CinderUnicodeTest-1925328654 None] Lock "cinder-ae3799f5-9526-4f61-ac63-3ff105170a12-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:09:35 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f3df586d-eefd-4dd2-ba1b-9526c8dd9aaf tempest-CinderUnicodeTest-1925328654 None] Acquiring lock "cinder-8c9279d8-39ba-4f69-ae43-abfa3aa08308-delete_volume" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:09:35 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f3df586d-eefd-4dd2-ba1b-9526c8dd9aaf tempest-CinderUnicodeTest-1925328654 None] Lock "cinder-8c9279d8-39ba-4f69-ae43-abfa3aa08308-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:09:35 devstack cinder-volume[82594]: WARNING cinder.volume.volume_utils [None req-f3df586d-eefd-4dd2-ba1b-9526c8dd9aaf tempest-CinderUnicodeTest-1925328654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 12:09:35 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f3df586d-eefd-4dd2-ba1b-9526c8dd9aaf tempest-CinderUnicodeTest-1925328654 None] Acquiring lock "cinder-quobyte-8c9279d8-39ba-4f69-ae43-abfa3aa08308" by "delete_volume" {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 12:09:35 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f3df586d-eefd-4dd2-ba1b-9526c8dd9aaf tempest-CinderUnicodeTest-1925328654 None] Lock "cinder-quobyte-8c9279d8-39ba-4f69-ae43-abfa3aa08308" acquired by "delete_volume" :: waited 0.012s {{(pid=82594) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 12:09:35 devstack cinder-volume[82594]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b13f33-8845-4156-abbd-78f0b6aa214a]: (4, 'qcow2') {{(pid=83617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 12:09:35 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f3df586d-eefd-4dd2-ba1b-9526c8dd9aaf tempest-CinderUnicodeTest-1925328654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8c9279d8-39ba-4f69-ae43-abfa3aa08308 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f3df586d-eefd-4dd2-ba1b-9526c8dd9aaf tempest-CinderUnicodeTest-1925328654 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8c9279d8-39ba-4f69-ae43-abfa3aa08308" returned: 0 in 0.450s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f3df586d-eefd-4dd2-ba1b-9526c8dd9aaf tempest-CinderUnicodeTest-1925328654 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8c9279d8-39ba-4f69-ae43-abfa3aa08308 {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f3df586d-eefd-4dd2-ba1b-9526c8dd9aaf tempest-CinderUnicodeTest-1925328654 None] CMD "rm -f /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf/volume-8c9279d8-39ba-4f69-ae43-abfa3aa08308" returned: 0 in 0.101s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:36 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f3df586d-eefd-4dd2-ba1b-9526c8dd9aaf tempest-CinderUnicodeTest-1925328654 None] Lock "cinder-quobyte-8c9279d8-39ba-4f69-ae43-abfa3aa08308" released by "delete_volume" :: held 0.685s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:09:36 devstack cinder-volume[82594]: DEBUG cinder.quota [None req-f3df586d-eefd-4dd2-ba1b-9526c8dd9aaf tempest-CinderUnicodeTest-1925328654 None] Created reservations ['0dddc682-18a6-45a5-8d5a-83a9cc1ea6f6', '32b479b1-0417-4b29-a442-d3943521d656', 'd6ce4f43-c73d-4490-82d0-d2ee8083a82f', 'bfa637dc-ccb1-41e2-a64f-a493cdb1c2ea'] {{(pid=82594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 12:09:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f3df586d-eefd-4dd2-ba1b-9526c8dd9aaf tempest-CinderUnicodeTest-1925328654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 12:09:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f3df586d-eefd-4dd2-ba1b-9526c8dd9aaf tempest-CinderUnicodeTest-1925328654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 12:09:36 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f3df586d-eefd-4dd2-ba1b-9526c8dd9aaf tempest-CinderUnicodeTest-1925328654 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56': None} {{(pid=82594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 12:09:36 devstack cinder-volume[82594]: DEBUG cinder.volume.drivers.quobyte [None req-f3df586d-eefd-4dd2-ba1b-9526c8dd9aaf tempest-CinderUnicodeTest-1925328654 None] Available shares ['10.10.41.181/cinder-vol-8328faf9-b37e-44a2-a878-fea68bac4b56'] {{(pid=82594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 12:09:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.lockutils [None req-f3df586d-eefd-4dd2-ba1b-9526c8dd9aaf tempest-CinderUnicodeTest-1925328654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82594) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 12:09:36 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f3df586d-eefd-4dd2-ba1b-9526c8dd9aaf tempest-CinderUnicodeTest-1925328654 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 12:09:37 devstack cinder-volume[82594]: DEBUG oslo_concurrency.processutils [None req-f3df586d-eefd-4dd2-ba1b-9526c8dd9aaf tempest-CinderUnicodeTest-1925328654 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fd9826adc75f1d2e9ab4b921d7cbdecf" returned: 0 in 0.104s {{(pid=82594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 12:09:37 devstack cinder-volume[82594]: DEBUG cinder.manager [None req-f3df586d-eefd-4dd2-ba1b-9526c8dd9aaf tempest-CinderUnicodeTest-1925328654 None] Notifying Schedulers of capabilities ... {{(pid=82594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 12:09:37 devstack cinder-volume[82594]: INFO cinder.volume.manager [None req-f3df586d-eefd-4dd2-ba1b-9526c8dd9aaf tempest-CinderUnicodeTest-1925328654 None] Deleted volume successfully.
Sep 10 12:09:37 devstack cinder-volume[82594]: DEBUG cinder.coordination [None req-f3df586d-eefd-4dd2-ba1b-9526c8dd9aaf tempest-CinderUnicodeTest-1925328654 None] Lock "cinder-8c9279d8-39ba-4f69-ae43-abfa3aa08308-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=82594) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 12:09:46 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:INSERT=35,cinder:UPDATE=128,cinder:SELECT=80,cinder:DELETE=11 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 12:09:47 devstack cinder-volume[82594]: DEBUG dbcounter [-] [82594] Writing DB stats cinder:SELECT=85,cinder:INSERT=30,cinder:UPDATE=128,cinder:DELETE=12 {{(pid=82594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}